Apr 13 22:46:26 user devstack@n-api.service[61610]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 13 22:46:26 user devstack@n-api.service[61610]: *** Starting uWSGI 2.0.20-debian (64bit) on [Thu Apr 13 22:46:26 2023] *** Apr 13 22:46:26 user devstack@n-api.service[61610]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 13 22:46:26 user devstack@n-api.service[61610]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 13 22:46:26 user devstack@n-api.service[61610]: nodename: user Apr 13 22:46:26 user devstack@n-api.service[61610]: machine: x86_64 Apr 13 22:46:26 user devstack@n-api.service[61610]: clock source: unix Apr 13 22:46:26 user devstack@n-api.service[61610]: pcre jit disabled Apr 13 22:46:26 user devstack@n-api.service[61610]: detected number of CPU cores: 12 Apr 13 22:46:26 user devstack@n-api.service[61610]: current working directory: / Apr 13 22:46:26 user devstack@n-api.service[61610]: detected binary path: /usr/bin/uwsgi-core Apr 13 22:46:26 user devstack@n-api.service[61610]: your processes number limit is 63637 Apr 13 22:46:26 user devstack@n-api.service[61610]: your memory page size is 4096 bytes Apr 13 22:46:26 user devstack@n-api.service[61610]: detected max file descriptor number: 2048 Apr 13 22:46:26 user devstack@n-api.service[61610]: lock engine: pthread robust mutexes Apr 13 22:46:26 user devstack@n-api.service[61610]: thunder lock: enabled Apr 13 22:46:26 user devstack@n-api.service[61610]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 13 22:46:26 user devstack@n-api.service[61610]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 13 22:46:26 user devstack@n-api.service[61610]: Python main interpreter initialized at 0x557a88a2c990 Apr 13 22:46:26 user devstack@n-api.service[61610]: python threads support enabled Apr 13 22:46:26 user devstack@n-api.service[61610]: your server socket listen backlog is limited to 100 connections Apr 13 22:46:26 user devstack@n-api.service[61610]: your mercy for graceful operations on workers is 90 seconds Apr 13 22:46:26 user devstack@n-api.service[61610]: mapped 537436 bytes (524 KB) for 3 cores Apr 13 22:46:26 user devstack@n-api.service[61610]: *** Operational MODE: preforking *** Apr 13 22:46:26 user devstack@n-api.service[61610]: *** uWSGI is running in multiple interpreter mode *** Apr 13 22:46:26 user devstack@n-api.service[61610]: spawned uWSGI master process (pid: 61610) Apr 13 22:46:26 user devstack@n-api.service[61610]: spawned uWSGI worker 1 (pid: 61611, cores: 1) Apr 13 22:46:26 user devstack@n-api.service[61610]: spawned uWSGI worker 2 (pid: 61612, cores: 1) Apr 13 22:46:26 user devstack@n-api.service[61610]: spawned uWSGI worker 3 (pid: 61613, cores: 1) Apr 13 22:46:26 user devstack@n-api.service[61610]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 13 22:46:27 user devstack@n-api.service[61613]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 22:46:27 user devstack@n-api.service[61612]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 22:46:27 user devstack@n-api.service[61611]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 22:46:30 user devstack@n-api.service[61612]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 22:46:30 user devstack@n-api.service[61612]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 22:46:30 user devstack@n-api.service[61612]: and ``live_migration_inbound_addr`` respectively. Apr 13 22:46:30 user devstack@n-api.service[61612]: ). Its value may be silently ignored in the future. Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 22:46:30 user devstack@n-api.service[61611]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 22:46:30 user devstack@n-api.service[61611]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 22:46:30 user devstack@n-api.service[61611]: and ``live_migration_inbound_addr`` respectively. Apr 13 22:46:30 user devstack@n-api.service[61611]: ). Its value may be silently ignored in the future. Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 22:46:30 user devstack@n-api.service[61613]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 22:46:30 user devstack@n-api.service[61613]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 22:46:30 user devstack@n-api.service[61613]: and ``live_migration_inbound_addr`` respectively. Apr 13 22:46:30 user devstack@n-api.service[61613]: ). Its value may be silently ignored in the future. Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 22:46:31 user devstack@n-api.service[61612]: INFO dbcounter [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] Registered counter for database nova_api Apr 13 22:46:31 user devstack@n-api.service[61613]: INFO dbcounter [None req-ae179a33-ea42-4876-aad1-e1df2626c396 None None] Registered counter for database nova_api Apr 13 22:46:31 user devstack@n-api.service[61611]: INFO dbcounter [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] Registered counter for database nova_api Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG oslo_db.sqlalchemy.engines [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61612) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG oslo_db.sqlalchemy.engines [None req-ae179a33-ea42-4876-aad1-e1df2626c396 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61613) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writer thread running {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writer thread running {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG oslo_db.sqlalchemy.engines [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61611) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writer thread running {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG nova.context [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68a91cc6-885a-441b-9070-4df9e8f73102(cell1) {{(pid=61612) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG nova.context [None req-ae179a33-ea42-4876-aad1-e1df2626c396 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68a91cc6-885a-441b-9070-4df9e8f73102(cell1) {{(pid=61613) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ae179a33-ea42-4876-aad1-e1df2626c396 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ae179a33-ea42-4876-aad1-e1df2626c396 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ae179a33-ea42-4876-aad1-e1df2626c396 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ae179a33-ea42-4876-aad1-e1df2626c396 None None] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ae179a33-ea42-4876-aad1-e1df2626c396 None None] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:46:31 user devstack@n-api.service[61612]: INFO dbcounter [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] Registered counter for database nova_cell0 Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ae179a33-ea42-4876-aad1-e1df2626c396 None None] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:46:31 user devstack@n-api.service[61613]: INFO dbcounter [None req-ae179a33-ea42-4876-aad1-e1df2626c396 None None] Registered counter for database nova_cell0 Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG nova.context [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68a91cc6-885a-441b-9070-4df9e8f73102(cell1) {{(pid=61611) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 22:46:31 user devstack@n-api.service[61612]: INFO dbcounter [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] Registered counter for database nova_cell1 Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:46:31 user devstack@n-api.service[61613]: INFO dbcounter [None req-ae179a33-ea42-4876-aad1-e1df2626c396 None None] Registered counter for database nova_cell1 Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:46:31 user devstack@n-api.service[61611]: INFO dbcounter [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] Registered counter for database nova_cell0 Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG oslo_db.sqlalchemy.engines [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61612) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 22:46:31 user devstack@n-api.service[61611]: INFO dbcounter [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] Registered counter for database nova_cell1 Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG oslo_db.sqlalchemy.engines [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61612) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG oslo_db.sqlalchemy.engines [None req-ae179a33-ea42-4876-aad1-e1df2626c396 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61613) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writer thread running {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writer thread running {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG oslo_db.sqlalchemy.engines [None req-ae179a33-ea42-4876-aad1-e1df2626c396 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61613) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writer thread running {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG oslo_db.sqlalchemy.engines [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61611) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writer thread running {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG oslo_db.sqlalchemy.engines [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61611) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writer thread running {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 22:46:31 user devstack@n-api.service[61612]: INFO dbcounter [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] Registered counter for database nova_cell0 Apr 13 22:46:31 user devstack@n-api.service[61613]: INFO dbcounter [None req-ae179a33-ea42-4876-aad1-e1df2626c396 None None] Registered counter for database nova_cell0 Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writer thread running {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG oslo_db.sqlalchemy.engines [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61612) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 22:46:31 user devstack@n-api.service[61611]: INFO dbcounter [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] Registered counter for database nova_cell0 Apr 13 22:46:31 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writer thread running {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG oslo_db.sqlalchemy.engines [None req-ae179a33-ea42-4876-aad1-e1df2626c396 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61613) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 22:46:31 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writer thread running {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG oslo_db.sqlalchemy.engines [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61611) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 22:46:31 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writer thread running {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 22:46:31 user devstack@n-api.service[61611]: WARNING keystonemiddleware.auth_token [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 22:46:31 user devstack@n-api.service[61611]: WARNING keystonemiddleware.auth_token [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 22:46:31 user devstack@n-api.service[61613]: WARNING keystonemiddleware.auth_token [None req-ae179a33-ea42-4876-aad1-e1df2626c396 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 22:46:31 user devstack@n-api.service[61613]: WARNING keystonemiddleware.auth_token [None req-ae179a33-ea42-4876-aad1-e1df2626c396 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 22:46:31 user devstack@n-api.service[61612]: WARNING keystonemiddleware.auth_token [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 22:46:31 user devstack@n-api.service[61612]: WARNING keystonemiddleware.auth_token [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 22:46:32 user devstack@n-api.service[61611]: WARNING keystonemiddleware.auth_token [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 22:46:32 user devstack@n-api.service[61611]: WARNING keystonemiddleware.auth_token [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 22:46:32 user devstack@n-api.service[61611]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557a88a2c990 pid: 61611 (default app) Apr 13 22:46:32 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:46:32 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.002630 Apr 13 22:46:32 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Thu Apr 13 22:46:32 2023] GET /compute/v2.1/ => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:46:32 user devstack@n-api.service[61613]: WARNING keystonemiddleware.auth_token [None req-ae179a33-ea42-4876-aad1-e1df2626c396 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 22:46:32 user devstack@n-api.service[61613]: WARNING keystonemiddleware.auth_token [None req-ae179a33-ea42-4876-aad1-e1df2626c396 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 22:46:32 user devstack@n-api.service[61613]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557a88a2c990 pid: 61613 (default app) Apr 13 22:46:32 user devstack@n-api.service[61612]: WARNING keystonemiddleware.auth_token [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 22:46:32 user devstack@n-api.service[61612]: WARNING keystonemiddleware.auth_token [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 22:46:32 user devstack@n-api.service[61612]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557a88a2c990 pid: 61612 (default app) Apr 13 22:48:40 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:48:40 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-a5a122ce-5f24-44cc-879d-65a1e743da2e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001584 Apr 13 22:48:40 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 22:48:40 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:48:40 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=3 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:48:40 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=3 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:48:40 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=3 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:48:40 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:48:40 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-40542384-9439-40aa-a0c1-5bff6c1c1539 admin admin] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:48:40 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-40542384-9439-40aa-a0c1-5bff6c1c1539 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.432383 Apr 13 22:48:40 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 13 22:48:40 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:48:42 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:48:42 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001870 Apr 13 22:48:42 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 22:48:42 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:48:42 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=3 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:48:42 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=3 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:48:42 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=3 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:48:42 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:48:42 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c8fe284b-5740-44aa-b4dd-b49f4419cb25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "vcpus": 1, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:48:42 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-c8fe284b-5740-44aa-b4dd-b49f4419cb25 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.325114 Apr 13 22:48:42 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 22:48:42 2023] POST /compute/v2.1/flavors => generated 405 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 22:48:42 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-66ac1c0b-3405-4b8a-af69-68165533c5df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:48:42 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-66ac1c0b-3405-4b8a-af69-68165533c5df admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057311 Apr 13 22:48:42 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 22:48:42 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:48:44 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:48:44 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001256 Apr 13 22:48:44 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 22:48:44 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:48:44 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-e9af8cce-d686-4e40-bc5a-c95a6ebb0a7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:48:44 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-e9af8cce-d686-4e40-bc5a-c95a6ebb0a7c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.064174 Apr 13 22:48:44 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 22:48:44 2023] POST /compute/v2.1/flavors => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 22:48:44 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8fcde7bb-d47f-4c83-a52a-25be6908ebfc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:48:44 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-8fcde7bb-d47f-4c83-a52a-25be6908ebfc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036835 Apr 13 22:48:44 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 22:48:44 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:48:46 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:48:46 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001292 Apr 13 22:48:46 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 22:48:46 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:48:46 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-ffc0c255-8469-44bb-a57a-2833cc1186f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:48:46 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-ffc0c255-8469-44bb-a57a-2833cc1186f2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.068218 Apr 13 22:48:46 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 22:48:46 2023] POST /compute/v2.1/flavors => generated 402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 22:48:46 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-cf401ac5-bf9f-4a54-a8bf-5d27eb1e4c1b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:48:46 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-cf401ac5-bf9f-4a54-a8bf-5d27eb1e4c1b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030795 Apr 13 22:48:46 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 22:48:46 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:48:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:48:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001292 Apr 13 22:48:48 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 22:48:48 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:48:48 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-de1410cb-281c-4d02-b636-8a3f6cdfe2b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "name": "ds2G", "disk": 10}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:48:48 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-de1410cb-281c-4d02-b636-8a3f6cdfe2b2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.066638 Apr 13 22:48:48 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 22:48:48 2023] POST /compute/v2.1/flavors => generated 402 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 22:48:49 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8136e6f5-33ea-4bc9-83de-96c0249ddc24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:48:49 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-8136e6f5-33ea-4bc9-83de-96c0249ddc24 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034021 Apr 13 22:48:49 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 22:48:48 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:48:50 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:48:50 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001392 Apr 13 22:48:50 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 22:48:50 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:48:50 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-eb691572-6d27-4d85-ae26-f47a6670a316 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:48:50 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-eb691572-6d27-4d85-ae26-f47a6670a316 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.057472 Apr 13 22:48:50 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 22:48:50 2023] POST /compute/v2.1/flavors => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 22:48:50 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-650290f0-5b60-4c87-99ab-961fdbdde01f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:48:50 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-650290f0-5b60-4c87-99ab-961fdbdde01f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040788 Apr 13 22:48:51 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 22:48:50 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:48:52 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:48:52 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-cf43f21f-8f48-4942-851f-a00f43817fca None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001438 Apr 13 22:48:52 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 22:48:52 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:48:52 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-08b6dcee-6070-4cd8-a67d-0e12b3a26157 admin admin] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:48:52 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-08b6dcee-6070-4cd8-a67d-0e12b3a26157 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.067714 Apr 13 22:48:52 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 13 22:48:52 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 22:48:54 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-650290f0-5b60-4c87-99ab-961fdbdde01f admin admin] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:48:54 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-650290f0-5b60-4c87-99ab-961fdbdde01f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001852 Apr 13 22:48:54 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 22:48:54 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:48:54 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:48:54 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:48:54 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:48:54 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:48:55 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-51f6ab71-0cd7-4e8f-84c5-5afd54c4d5b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1", "vcpus": 1}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:48:55 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-51f6ab71-0cd7-4e8f-84c5-5afd54c4d5b5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.324445 Apr 13 22:48:55 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 22:48:54 2023] POST /compute/v2.1/flavors => generated 400 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 22:48:55 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-213a3a07-bf59-4394-a0a8-e681c636489a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:48:55 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-213a3a07-bf59-4394-a0a8-e681c636489a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038195 Apr 13 22:48:55 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 22:48:55 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:48:57 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-650290f0-5b60-4c87-99ab-961fdbdde01f admin admin] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:48:57 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-650290f0-5b60-4c87-99ab-961fdbdde01f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001545 Apr 13 22:48:57 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 22:48:57 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:48:57 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-36cbb581-1daf-4dca-998c-f88a80adddf2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 1, "id": "2"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:48:57 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-36cbb581-1daf-4dca-998c-f88a80adddf2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.059836 Apr 13 22:48:57 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 22:48:57 2023] POST /compute/v2.1/flavors => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 22:48:57 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-94dde764-43f4-4785-b53e-cdf1adffb274 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:48:57 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-94dde764-43f4-4785-b53e-cdf1adffb274 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027969 Apr 13 22:48:57 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 22:48:57 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:48:59 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-650290f0-5b60-4c87-99ab-961fdbdde01f admin admin] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:48:59 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-650290f0-5b60-4c87-99ab-961fdbdde01f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001492 Apr 13 22:48:59 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 22:48:59 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:48:59 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-f2fbf9ac-c190-472b-afbb-5bc4b0f7fc3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:48:59 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-f2fbf9ac-c190-472b-afbb-5bc4b0f7fc3a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.102253 Apr 13 22:48:59 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 22:48:59 2023] POST /compute/v2.1/flavors => generated 404 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 22:48:59 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-8db0382c-51ab-4750-b6b7-c631938434e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:48:59 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-8db0382c-51ab-4750-b6b7-c631938434e0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025518 Apr 13 22:48:59 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 22:48:59 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:49:01 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-650290f0-5b60-4c87-99ab-961fdbdde01f admin admin] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:49:01 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-650290f0-5b60-4c87-99ab-961fdbdde01f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002354 Apr 13 22:49:01 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 22:49:01 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:49:01 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-859cb947-1716-430c-a923-28c01e663b5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "4", "vcpus": 4, "ram": 8192, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:49:01 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-859cb947-1716-430c-a923-28c01e663b5a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.063540 Apr 13 22:49:01 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 22:49:01 2023] POST /compute/v2.1/flavors => generated 403 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 22:49:01 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-e4a6c798-2210-4d7d-ae25-775ba209b9c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:49:01 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-e4a6c798-2210-4d7d-ae25-775ba209b9c1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023256 Apr 13 22:49:01 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 22:49:01 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:49:03 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-650290f0-5b60-4c87-99ab-961fdbdde01f admin admin] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:49:03 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-650290f0-5b60-4c87-99ab-961fdbdde01f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001547 Apr 13 22:49:03 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 22:49:03 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:49:03 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-2b23c8ff-2cc8-4d63-bdea-8450c0ce1897 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384, "id": "5"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:49:03 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-2b23c8ff-2cc8-4d63-bdea-8450c0ce1897 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.060049 Apr 13 22:49:03 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 22:49:03 2023] POST /compute/v2.1/flavors => generated 406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 22:49:03 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c4e30001-5bf3-419b-b079-45c2b780da71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:49:03 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-c4e30001-5bf3-419b-b079-45c2b780da71 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023126 Apr 13 22:49:03 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 22:49:03 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:49:34 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-650290f0-5b60-4c87-99ab-961fdbdde01f admin admin] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:49:34 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-650290f0-5b60-4c87-99ab-961fdbdde01f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001673 Apr 13 22:49:34 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 22:49:34 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:49:34 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:49:34 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-4697d8ee-9117-4e9c-91d0-eb41409b0117 admin admin] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:49:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4697d8ee-9117-4e9c-91d0-eb41409b0117 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:49:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4697d8ee-9117-4e9c-91d0-eb41409b0117 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:49:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4697d8ee-9117-4e9c-91d0-eb41409b0117 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:49:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4697d8ee-9117-4e9c-91d0-eb41409b0117 admin admin] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:49:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4697d8ee-9117-4e9c-91d0-eb41409b0117 admin admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:49:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4697d8ee-9117-4e9c-91d0-eb41409b0117 admin admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:49:34 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-4697d8ee-9117-4e9c-91d0-eb41409b0117 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.089872 Apr 13 22:49:34 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Thu Apr 13 22:49:34 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 22:50:06 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c4e30001-5bf3-419b-b079-45c2b780da71 admin admin] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:50:06 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-c4e30001-5bf3-419b-b079-45c2b780da71 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002246 Apr 13 22:50:06 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 22:50:06 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:50:06 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:50:06 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8c73a945-8201-4288-98b4-94f83af001a8 admin admin] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:50:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-8c73a945-8201-4288-98b4-94f83af001a8 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.081086 Apr 13 22:50:06 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Thu Apr 13 22:50:06 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 22:50:10 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-4697d8ee-9117-4e9c-91d0-eb41409b0117 admin admin] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:50:10 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-4697d8ee-9117-4e9c-91d0-eb41409b0117 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001484 Apr 13 22:50:10 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 22:50:10 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:50:10 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:50:10 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-ee8e1e49-284a-4e95-b16b-6522d489a0a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 128, "os-flavor-access:is_public": true, "name": "m1.nano", "swap": 0, "id": "42", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:50:10 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-ee8e1e49-284a-4e95-b16b-6522d489a0a5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.088745 Apr 13 22:50:10 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 13 22:50:10 2023] POST /compute/v2.1/flavors => generated 403 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 22:50:10 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5749e259-e6a1-401e-8974-469c232811f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:50:10 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-5749e259-e6a1-401e-8974-469c232811f8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025616 Apr 13 22:50:10 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 13 22:50:10 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:50:14 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-4697d8ee-9117-4e9c-91d0-eb41409b0117 admin admin] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:50:14 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-4697d8ee-9117-4e9c-91d0-eb41409b0117 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001478 Apr 13 22:50:14 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 22:50:14 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:50:14 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5cb4bdce-7104-4eaf-876e-df47b99f48f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "84", "disk": 1, "ram": 192, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.micro", "os-flavor-access:is_public": true}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:50:14 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-5cb4bdce-7104-4eaf-876e-df47b99f48f1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.063592 Apr 13 22:50:14 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 13 22:50:14 2023] POST /compute/v2.1/flavors => generated 404 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 22:50:14 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-362dfd26-e1f0-4678-98dd-a2a62390b8e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:50:14 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-362dfd26-e1f0-4678-98dd-a2a62390b8e6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027698 Apr 13 22:50:14 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 13 22:50:14 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:52:26 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:52:26 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:52:26 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:52:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-d3d440cb-47b6-49f6-ac0f-dc1c1596c536 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] Action: 'create', calling method: .version_select at 0x7f3d1ed62b00>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1649374865", "metadata": {"Type": "work"}}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:52:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-d3d440cb-47b6-49f6-ac0f-dc1c1596c536 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] Request method failure captured: Apr 13 22:52:27 user devstack@n-api.service[61612]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 22:52:27 user devstack@n-api.service[61612]: Accept: application/json Apr 13 22:52:27 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 22:52:27 user devstack@n-api.service[61612]: Connection: close Apr 13 22:52:27 user devstack@n-api.service[61612]: Content-Length: 122 Apr 13 22:52:27 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 22:52:27 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 22:52:27 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 22:52:27 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIeqgGUjap83wvhiYE_Bo05G_cV3L6OP_CzuU8IcyFoZHxMvPPZI4oNuHJg5K5Axhl1tJ6Sgs8_o9B-JdvVG6BwJGQpdeKutHMHHxtGDvNQ67-ZdzTG4uKQuTJC1wKE2cIT_OFj2lbA3lXAFyCcZtNorH0H76PrH5RPJ86iJ1UsnAJo Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Project-Id: 94e8cb3e4ea1459c9ffa23c4d629ac57 Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Project-Name: tempest-VolumesNegativeTest-476008543 Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/94e8cb3e4ea1459c9ffa23c4d629ac57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e8cb3e4ea1459c9ffa23c4d629ac57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e8cb3e4ea1459c9ffa23c4d629ac57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Tenant: tempest-VolumesNegativeTest-476008543 Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Tenant-Id: 94e8cb3e4ea1459c9ffa23c4d629ac57 Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-VolumesNegativeTest-476008543 Apr 13 22:52:27 user devstack@n-api.service[61612]: X-User: tempest-VolumesNegativeTest-476008543-project-member Apr 13 22:52:27 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 22:52:27 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 22:52:27 user devstack@n-api.service[61612]: X-User-Id: 1719bc02a3e6423a8414ff05b7a884ae Apr 13 22:52:27 user devstack@n-api.service[61612]: X-User-Name: tempest-VolumesNegativeTest-476008543-project-member Apr 13 22:52:27 user devstack@n-api.service[61612]: Apr 13 22:52:27 user devstack@n-api.service[61612]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1649374865", "metadata": {"Type": "work"}}} Apr 13 22:52:27 user devstack@n-api.service[61612]: method: Apr 13 22:52:27 user devstack@n-api.service[61612]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 22:52:27 user devstack@n-api.service[61612]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1649374865', 'metadata': {'Type': 'work'}}}} Apr 13 22:52:27 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise error Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi '#$%' Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-d3d440cb-47b6-49f6-ac0f-dc1c1596c536 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:52:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-d3d440cb-47b6-49f6-ac0f-dc1c1596c536 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.416322 Apr 13 22:52:27 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 22:52:26 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 417 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 22:52:27 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-30b821f4-4163-4bd8-b970-707c8e4017a3 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] Action: 'create', calling method: .version_select at 0x7f3d1ed67490>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1912035464", "metadata": {"Type": "work"}}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:52:27 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-30b821f4-4163-4bd8-b970-707c8e4017a3 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] Request method failure captured: Apr 13 22:52:27 user devstack@n-api.service[61611]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 22:52:27 user devstack@n-api.service[61611]: Accept: application/json Apr 13 22:52:27 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 22:52:27 user devstack@n-api.service[61611]: Connection: close Apr 13 22:52:27 user devstack@n-api.service[61611]: Content-Length: 120 Apr 13 22:52:27 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 22:52:27 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 22:52:27 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 22:52:27 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 22:52:27 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIeqgGUjap83wvhiYE_Bo05G_cV3L6OP_CzuU8IcyFoZHxMvPPZI4oNuHJg5K5Axhl1tJ6Sgs8_o9B-JdvVG6BwJGQpdeKutHMHHxtGDvNQ67-ZdzTG4uKQuTJC1wKE2cIT_OFj2lbA3lXAFyCcZtNorH0H76PrH5RPJ86iJ1UsnAJo Apr 13 22:52:27 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 22:52:27 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 22:52:27 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 22:52:27 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 22:52:27 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 22:52:27 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 22:52:27 user devstack@n-api.service[61611]: X-Project-Id: 94e8cb3e4ea1459c9ffa23c4d629ac57 Apr 13 22:52:27 user devstack@n-api.service[61611]: X-Project-Name: tempest-VolumesNegativeTest-476008543 Apr 13 22:52:27 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 22:52:27 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 22:52:27 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/94e8cb3e4ea1459c9ffa23c4d629ac57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e8cb3e4ea1459c9ffa23c4d629ac57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e8cb3e4ea1459c9ffa23c4d629ac57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:52:27 user devstack@n-api.service[61611]: X-Tenant: tempest-VolumesNegativeTest-476008543 Apr 13 22:52:27 user devstack@n-api.service[61611]: X-Tenant-Id: 94e8cb3e4ea1459c9ffa23c4d629ac57 Apr 13 22:52:27 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-VolumesNegativeTest-476008543 Apr 13 22:52:27 user devstack@n-api.service[61611]: X-User: tempest-VolumesNegativeTest-476008543-project-member Apr 13 22:52:27 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 22:52:27 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 22:52:27 user devstack@n-api.service[61611]: X-User-Id: 1719bc02a3e6423a8414ff05b7a884ae Apr 13 22:52:27 user devstack@n-api.service[61611]: X-User-Name: tempest-VolumesNegativeTest-476008543-project-member Apr 13 22:52:27 user devstack@n-api.service[61611]: Apr 13 22:52:27 user devstack@n-api.service[61611]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1912035464", "metadata": {"Type": "work"}}} Apr 13 22:52:27 user devstack@n-api.service[61611]: method: Apr 13 22:52:27 user devstack@n-api.service[61611]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 22:52:27 user devstack@n-api.service[61611]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1912035464', 'metadata': {'Type': 'work'}}}} Apr 13 22:52:27 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise error Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi '0' Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 22:52:27 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-30b821f4-4163-4bd8-b970-707c8e4017a3 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:52:27 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-30b821f4-4163-4bd8-b970-707c8e4017a3 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013483 Apr 13 22:52:27 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 22:52:27 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 22:52:27 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:52:27 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-9e9510da-9900-4b8a-abe7-f50f65f25a8c tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] Action: 'create', calling method: .version_select at 0x7f3d1eefa680>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1032203438", "metadata": {"Type": "work"}}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:52:27 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-9e9510da-9900-4b8a-abe7-f50f65f25a8c tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] Request method failure captured: Apr 13 22:52:27 user devstack@n-api.service[61613]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 22:52:27 user devstack@n-api.service[61613]: Accept: application/json Apr 13 22:52:27 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 22:52:27 user devstack@n-api.service[61613]: Connection: close Apr 13 22:52:27 user devstack@n-api.service[61613]: Content-Length: 119 Apr 13 22:52:27 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 22:52:27 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 22:52:27 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 22:52:27 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 22:52:27 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIeqgGUjap83wvhiYE_Bo05G_cV3L6OP_CzuU8IcyFoZHxMvPPZI4oNuHJg5K5Axhl1tJ6Sgs8_o9B-JdvVG6BwJGQpdeKutHMHHxtGDvNQ67-ZdzTG4uKQuTJC1wKE2cIT_OFj2lbA3lXAFyCcZtNorH0H76PrH5RPJ86iJ1UsnAJo Apr 13 22:52:27 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 22:52:27 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 22:52:27 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 22:52:27 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 22:52:27 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 22:52:27 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 22:52:27 user devstack@n-api.service[61613]: X-Project-Id: 94e8cb3e4ea1459c9ffa23c4d629ac57 Apr 13 22:52:27 user devstack@n-api.service[61613]: X-Project-Name: tempest-VolumesNegativeTest-476008543 Apr 13 22:52:27 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 22:52:27 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 22:52:27 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/94e8cb3e4ea1459c9ffa23c4d629ac57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e8cb3e4ea1459c9ffa23c4d629ac57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e8cb3e4ea1459c9ffa23c4d629ac57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:52:27 user devstack@n-api.service[61613]: X-Tenant: tempest-VolumesNegativeTest-476008543 Apr 13 22:52:27 user devstack@n-api.service[61613]: X-Tenant-Id: 94e8cb3e4ea1459c9ffa23c4d629ac57 Apr 13 22:52:27 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-VolumesNegativeTest-476008543 Apr 13 22:52:27 user devstack@n-api.service[61613]: X-User: tempest-VolumesNegativeTest-476008543-project-member Apr 13 22:52:27 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 22:52:27 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 22:52:27 user devstack@n-api.service[61613]: X-User-Id: 1719bc02a3e6423a8414ff05b7a884ae Apr 13 22:52:27 user devstack@n-api.service[61613]: X-User-Name: tempest-VolumesNegativeTest-476008543-project-member Apr 13 22:52:27 user devstack@n-api.service[61613]: Apr 13 22:52:27 user devstack@n-api.service[61613]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1032203438", "metadata": {"Type": "work"}}} Apr 13 22:52:27 user devstack@n-api.service[61613]: method: Apr 13 22:52:27 user devstack@n-api.service[61613]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 22:52:27 user devstack@n-api.service[61613]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1032203438', 'metadata': {'Type': 'work'}}}} Apr 13 22:52:27 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise error Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi '' Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 22:52:27 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-9e9510da-9900-4b8a-abe7-f50f65f25a8c tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:52:27 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-9e9510da-9900-4b8a-abe7-f50f65f25a8c tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013165 Apr 13 22:52:27 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 22:52:27 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 22:52:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-3e8680ad-2a8f-4a17-b520-24e138026529 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] Calling method '.version_select at 0x7f3d1ed9cca0>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:52:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-3e8680ad-2a8f-4a17-b520-24e138026529 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] HTTP exception thrown: Volume tempest-invalid-1115528013 could not be found. Apr 13 22:52:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-3e8680ad-2a8f-4a17-b520-24e138026529 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] Request method failure captured: Apr 13 22:52:27 user devstack@n-api.service[61612]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1115528013 HTTP/1.1 Apr 13 22:52:27 user devstack@n-api.service[61612]: Accept: application/json Apr 13 22:52:27 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 22:52:27 user devstack@n-api.service[61612]: Connection: close Apr 13 22:52:27 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 22:52:27 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 22:52:27 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 22:52:27 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 22:52:27 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIeqgGUjap83wvhiYE_Bo05G_cV3L6OP_CzuU8IcyFoZHxMvPPZI4oNuHJg5K5Axhl1tJ6Sgs8_o9B-JdvVG6BwJGQpdeKutHMHHxtGDvNQ67-ZdzTG4uKQuTJC1wKE2cIT_OFj2lbA3lXAFyCcZtNorH0H76PrH5RPJ86iJ1UsnAJo Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Project-Id: 94e8cb3e4ea1459c9ffa23c4d629ac57 Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Project-Name: tempest-VolumesNegativeTest-476008543 Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/94e8cb3e4ea1459c9ffa23c4d629ac57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e8cb3e4ea1459c9ffa23c4d629ac57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e8cb3e4ea1459c9ffa23c4d629ac57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Tenant: tempest-VolumesNegativeTest-476008543 Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Tenant-Id: 94e8cb3e4ea1459c9ffa23c4d629ac57 Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-VolumesNegativeTest-476008543 Apr 13 22:52:27 user devstack@n-api.service[61612]: X-User: tempest-VolumesNegativeTest-476008543-project-member Apr 13 22:52:27 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 22:52:27 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 22:52:27 user devstack@n-api.service[61612]: X-User-Id: 1719bc02a3e6423a8414ff05b7a884ae Apr 13 22:52:27 user devstack@n-api.service[61612]: X-User-Name: tempest-VolumesNegativeTest-476008543-project-member Apr 13 22:52:27 user devstack@n-api.service[61612]: method: Apr 13 22:52:27 user devstack@n-api.service[61612]: exception: Volume tempest-invalid-1115528013 could not be found. Apr 13 22:52:27 user devstack@n-api.service[61612]: action_args: {'id': 'tempest-invalid-1115528013'} Apr 13 22:52:27 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1115528013 could not be found. (HTTP 404) (Request-ID: req-34415d58-0a1a-4b43-8503-000d290a44b5) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1115528013 could not be found. Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1115528013 could not be found. Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1115528013 could not be found. Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-3e8680ad-2a8f-4a17-b520-24e138026529 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] Returning 404 to user: Volume tempest-invalid-1115528013 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:52:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-3e8680ad-2a8f-4a17-b520-24e138026529 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1115528013" status: 404 len: 99 microversion: 2.1 time: 0.498233 Apr 13 22:52:27 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 22:52:27 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1115528013 => generated 99 bytes in 500 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 13 22:52:27 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:52:27 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-08d11194-eb08-42bb-963b-b3db60cccc75 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006059 Apr 13 22:52:27 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 13 22:52:27 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 13 22:52:27 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-f6ab6678-93f9-475f-88ae-afc4cadc982c tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006842 Apr 13 22:52:27 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1214 bytes} [Thu Apr 13 22:52:27 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 13 22:52:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-5f36cd34-0aa6-4a0e-86ed-aece91f506b1 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] Calling method '.version_select at 0x7f3d1ec1e320>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:52:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-5f36cd34-0aa6-4a0e-86ed-aece91f506b1 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] HTTP exception thrown: Volume 894b2622-60e0-48cc-9af4-e38a311d496c could not be found. Apr 13 22:52:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-5f36cd34-0aa6-4a0e-86ed-aece91f506b1 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] Request method failure captured: Apr 13 22:52:27 user devstack@n-api.service[61612]: request: DELETE /compute/v2.1/os-volumes/894b2622-60e0-48cc-9af4-e38a311d496c HTTP/1.1 Apr 13 22:52:27 user devstack@n-api.service[61612]: Accept: application/json Apr 13 22:52:27 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 22:52:27 user devstack@n-api.service[61612]: Connection: close Apr 13 22:52:27 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 22:52:27 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 22:52:27 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 22:52:27 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 22:52:27 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIeqgGUjap83wvhiYE_Bo05G_cV3L6OP_CzuU8IcyFoZHxMvPPZI4oNuHJg5K5Axhl1tJ6Sgs8_o9B-JdvVG6BwJGQpdeKutHMHHxtGDvNQ67-ZdzTG4uKQuTJC1wKE2cIT_OFj2lbA3lXAFyCcZtNorH0H76PrH5RPJ86iJ1UsnAJo Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Project-Id: 94e8cb3e4ea1459c9ffa23c4d629ac57 Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Project-Name: tempest-VolumesNegativeTest-476008543 Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/94e8cb3e4ea1459c9ffa23c4d629ac57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e8cb3e4ea1459c9ffa23c4d629ac57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e8cb3e4ea1459c9ffa23c4d629ac57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Tenant: tempest-VolumesNegativeTest-476008543 Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Tenant-Id: 94e8cb3e4ea1459c9ffa23c4d629ac57 Apr 13 22:52:27 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-VolumesNegativeTest-476008543 Apr 13 22:52:27 user devstack@n-api.service[61612]: X-User: tempest-VolumesNegativeTest-476008543-project-member Apr 13 22:52:27 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 22:52:27 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 22:52:27 user devstack@n-api.service[61612]: X-User-Id: 1719bc02a3e6423a8414ff05b7a884ae Apr 13 22:52:27 user devstack@n-api.service[61612]: X-User-Name: tempest-VolumesNegativeTest-476008543-project-member Apr 13 22:52:27 user devstack@n-api.service[61612]: method: Apr 13 22:52:27 user devstack@n-api.service[61612]: exception: Volume 894b2622-60e0-48cc-9af4-e38a311d496c could not be found. Apr 13 22:52:27 user devstack@n-api.service[61612]: action_args: {'id': '894b2622-60e0-48cc-9af4-e38a311d496c'} Apr 13 22:52:27 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 894b2622-60e0-48cc-9af4-e38a311d496c could not be found. (HTTP 404) (Request-ID: req-caaca102-615a-4809-994e-38a7ed767fdd) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 894b2622-60e0-48cc-9af4-e38a311d496c could not be found. Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 894b2622-60e0-48cc-9af4-e38a311d496c could not be found. Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 894b2622-60e0-48cc-9af4-e38a311d496c could not be found. Apr 13 22:52:27 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:52:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-5f36cd34-0aa6-4a0e-86ed-aece91f506b1 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] Returning 404 to user: Volume 894b2622-60e0-48cc-9af4-e38a311d496c could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:52:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-5f36cd34-0aa6-4a0e-86ed-aece91f506b1 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/894b2622-60e0-48cc-9af4-e38a311d496c" status: 404 len: 109 microversion: 2.1 time: 0.045805 Apr 13 22:52:27 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 22:52:27 2023] DELETE /compute/v2.1/os-volumes/894b2622-60e0-48cc-9af4-e38a311d496c => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:52:27 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-cc06d948-e57b-4e94-bf57-fbf5d5336ed1 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] Calling method '.version_select at 0x7f3d1ed67010>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:52:28 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-cc06d948-e57b-4e94-bf57-fbf5d5336ed1 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] HTTP exception thrown: Volume 64928055-3241-447a-95a8-d0e0a5cc29ec could not be found. Apr 13 22:52:28 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-cc06d948-e57b-4e94-bf57-fbf5d5336ed1 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] Request method failure captured: Apr 13 22:52:28 user devstack@n-api.service[61611]: request: GET /compute/v2.1/os-volumes/64928055-3241-447a-95a8-d0e0a5cc29ec HTTP/1.1 Apr 13 22:52:28 user devstack@n-api.service[61611]: Accept: application/json Apr 13 22:52:28 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 22:52:28 user devstack@n-api.service[61611]: Connection: close Apr 13 22:52:28 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 22:52:28 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 22:52:28 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 22:52:28 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 22:52:28 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 22:52:28 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIeqgGUjap83wvhiYE_Bo05G_cV3L6OP_CzuU8IcyFoZHxMvPPZI4oNuHJg5K5Axhl1tJ6Sgs8_o9B-JdvVG6BwJGQpdeKutHMHHxtGDvNQ67-ZdzTG4uKQuTJC1wKE2cIT_OFj2lbA3lXAFyCcZtNorH0H76PrH5RPJ86iJ1UsnAJo Apr 13 22:52:28 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 22:52:28 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 22:52:28 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 22:52:28 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 22:52:28 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 22:52:28 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 22:52:28 user devstack@n-api.service[61611]: X-Project-Id: 94e8cb3e4ea1459c9ffa23c4d629ac57 Apr 13 22:52:28 user devstack@n-api.service[61611]: X-Project-Name: tempest-VolumesNegativeTest-476008543 Apr 13 22:52:28 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 22:52:28 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 22:52:28 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/94e8cb3e4ea1459c9ffa23c4d629ac57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e8cb3e4ea1459c9ffa23c4d629ac57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e8cb3e4ea1459c9ffa23c4d629ac57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:52:28 user devstack@n-api.service[61611]: X-Tenant: tempest-VolumesNegativeTest-476008543 Apr 13 22:52:28 user devstack@n-api.service[61611]: X-Tenant-Id: 94e8cb3e4ea1459c9ffa23c4d629ac57 Apr 13 22:52:28 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-VolumesNegativeTest-476008543 Apr 13 22:52:28 user devstack@n-api.service[61611]: X-User: tempest-VolumesNegativeTest-476008543-project-member Apr 13 22:52:28 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 22:52:28 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 22:52:28 user devstack@n-api.service[61611]: X-User-Id: 1719bc02a3e6423a8414ff05b7a884ae Apr 13 22:52:28 user devstack@n-api.service[61611]: X-User-Name: tempest-VolumesNegativeTest-476008543-project-member Apr 13 22:52:28 user devstack@n-api.service[61611]: method: Apr 13 22:52:28 user devstack@n-api.service[61611]: exception: Volume 64928055-3241-447a-95a8-d0e0a5cc29ec could not be found. Apr 13 22:52:28 user devstack@n-api.service[61611]: action_args: {'id': '64928055-3241-447a-95a8-d0e0a5cc29ec'} Apr 13 22:52:28 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 64928055-3241-447a-95a8-d0e0a5cc29ec could not be found. (HTTP 404) (Request-ID: req-1c0d6ac1-6ab8-4009-a1b4-57091ccb106a) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 64928055-3241-447a-95a8-d0e0a5cc29ec could not be found. Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 64928055-3241-447a-95a8-d0e0a5cc29ec could not be found. Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 64928055-3241-447a-95a8-d0e0a5cc29ec could not be found. Apr 13 22:52:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:52:28 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-cc06d948-e57b-4e94-bf57-fbf5d5336ed1 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] Returning 404 to user: Volume 64928055-3241-447a-95a8-d0e0a5cc29ec could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:52:28 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-cc06d948-e57b-4e94-bf57-fbf5d5336ed1 tempest-VolumesNegativeTest-476008543 tempest-VolumesNegativeTest-476008543-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/64928055-3241-447a-95a8-d0e0a5cc29ec" status: 404 len: 109 microversion: 2.1 time: 0.305858 Apr 13 22:52:28 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 22:52:27 2023] GET /compute/v2.1/os-volumes/64928055-3241-447a-95a8-d0e0a5cc29ec => generated 109 bytes in 308 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:52:36 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-d16aea29-32ef-4096-9d4d-ef97d87bbfa1 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Action: 'create', calling method: .version_select at 0x7f3d1eefb1c0>, body: {"keypair": {"name": "tempest-keypair-1726987531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNReEIIBUGN/js2VOAZ0TEIC4I0cZ3TqzAV1r7zPJAF/zIEIbTTJ6VirMRIqofzAmD3hSWWBbJmL3KAKtQPR9xf0O/2/ghxrWTFBBAxj0zncVIMD3cx/w1GJEFykqUBh0Q=="}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:52:36 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-d16aea29-32ef-4096-9d4d-ef97d87bbfa1 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Getting quotas for project d502d982f4fe424a8df8149962d46963. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:52:36 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-d16aea29-32ef-4096-9d4d-ef97d87bbfa1 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Getting quotas for user 3f03ab225421441098f94350bef24442 and project d502d982f4fe424a8df8149962d46963. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:52:36 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-d16aea29-32ef-4096-9d4d-ef97d87bbfa1 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.350962 Apr 13 22:52:36 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 18/54] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 22:52:35 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:52:40 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1424032268", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "networks": [{"uuid": "3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07"}], "security_groups": [{"name": "tempest-securitygroup--4871213"}], "key_name": "tempest-keypair-1726987531", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:52:41 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] validate_networks() for [('3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:52:42 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:52:42 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:52:42 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:52:42 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:52:42 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:52:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:52:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:52:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:52:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:52:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:52:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:52:42 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Getting quotas for project d502d982f4fe424a8df8149962d46963. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:52:42 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Getting quotas for user 3f03ab225421441098f94350bef24442 and project d502d982f4fe424a8df8149962d46963. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:52:42 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:52:42 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:52:43 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.229371 Apr 13 22:52:43 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 18/55] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:52:40 2023] POST /compute/v2.1/servers => generated 401 bytes in 2231 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 13 22:52:43 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-559dd250-5428-4eab-8c55-b0b9b51847bc tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:52:43 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-559dd250-5428-4eab-8c55-b0b9b51847bc tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:52:43 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-559dd250-5428-4eab-8c55-b0b9b51847bc tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03ab225421441098f94350bef24442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd502d982f4fe424a8df8149962d46963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:52:43 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-559dd250-5428-4eab-8c55-b0b9b51847bc tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499" status: 200 len: 1240 microversion: 2.1 time: 0.150177 Apr 13 22:52:43 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 20/56] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:52:43 2023] GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499 => generated 1240 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:52:48 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:52:48 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:52:49 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-1e9f044d-5b8a-4492-b976-b54d14a2a6be tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Action: 'create', calling method: .version_select at 0x7f3d1ec22d40>, body: {"keypair": {"name": "tempest-keypair-361428277", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYszYLHqm3TSsYG53y7yrRrp/BSu53oOaIQJh8QFzIdZE1yR8v0colL3Wr0n1bH725AWkN7xrgjULBo24JmIla1q/OA7HRKEOPTBBakoM2MAG7p8Rv2IXQuLAG6ZgBdKg=="}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:52:49 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-1e9f044d-5b8a-4492-b976-b54d14a2a6be tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Getting quotas for project d0648ea953174a8cae6085ac24d92bb1. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:52:49 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-1e9f044d-5b8a-4492-b976-b54d14a2a6be tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Getting quotas for user 13b46af525dd45678b69207e93683ac4 and project d0648ea953174a8cae6085ac24d92bb1. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:52:49 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-1e9f044d-5b8a-4492-b976-b54d14a2a6be tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.341269 Apr 13 22:52:49 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 19/57] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 22:52:48 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 22:52:49 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1321478870", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "networks": [{"uuid": "aae34c52-3257-4273-a867-367f7ba854fc"}]}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:52:49 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] validate_networks() for [('aae34c52-3257-4273-a867-367f7ba854fc', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:52:50 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:52:50 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:52:50 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:52:50 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:52:50 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:52:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:52:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:52:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:52:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:52:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:52:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:52:50 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Getting quotas for project 45c86d23c9fa4c60b53700b0798a215f. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:52:50 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Getting quotas for user bcdd77e681f9467db86ff56ff8f516b4 and project 45c86d23c9fa4c60b53700b0798a215f. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:52:50 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:52:50 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:52:51 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.019833 Apr 13 22:52:51 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 19/58] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:52:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 2022 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:52:51 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c8cfc975-345b-42ee-8e44-3c4725d88c50 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:52:51 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-c8cfc975-345b-42ee-8e44-3c4725d88c50 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:52:51 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-c8cfc975-345b-42ee-8e44-3c4725d88c50 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd77e681f9467db86ff56ff8f516b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c86d23c9fa4c60b53700b0798a215f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:52:51 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-c8cfc975-345b-42ee-8e44-3c4725d88c50 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154" status: 200 len: 1209 microversion: 2.1 time: 0.276976 Apr 13 22:52:51 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 21/59] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:52:51 2023] GET /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154 => generated 1209 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:52:53 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-bb8640a0-a247-4493-a2c0-2fa551de1dda req-4f55296e-753d-42a0-9929-0231fb350638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f241623-e618-42eb-87d1-0606e37ec499", "tag": "87e984d6-f653-4e7e-a230-53cd27a17d97"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:52:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-bb8640a0-a247-4493-a2c0-2fa551de1dda req-4f55296e-753d-42a0-9929-0231fb350638 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:52:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-bb8640a0-a247-4493-a2c0-2fa551de1dda req-4f55296e-753d-42a0-9929-0231fb350638 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:52:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-bb8640a0-a247-4493-a2c0-2fa551de1dda req-4f55296e-753d-42a0-9929-0231fb350638 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:52:53 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-bb8640a0-a247-4493-a2c0-2fa551de1dda req-4f55296e-753d-42a0-9929-0231fb350638 service nova] Creating event network-changed:87e984d6-f653-4e7e-a230-53cd27a17d97 for instance 3f241623-e618-42eb-87d1-0606e37ec499 on user Apr 13 22:52:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-bb8640a0-a247-4493-a2c0-2fa551de1dda req-4f55296e-753d-42a0-9929-0231fb350638 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61613) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 22:52:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-bb8640a0-a247-4493-a2c0-2fa551de1dda req-4f55296e-753d-42a0-9929-0231fb350638 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61613) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 22:52:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-89e4265f-c2a2-405b-ac13-93d86e999a92 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:52:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-89e4265f-c2a2-405b-ac13-93d86e999a92 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:52:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-89e4265f-c2a2-405b-ac13-93d86e999a92 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:52:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-89e4265f-c2a2-405b-ac13-93d86e999a92 None None] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:52:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-89e4265f-c2a2-405b-ac13-93d86e999a92 None None] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:52:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-89e4265f-c2a2-405b-ac13-93d86e999a92 None None] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:52:53 user devstack@n-api.service[61613]: INFO nova.compute.rpcapi [None req-89e4265f-c2a2-405b-ac13-93d86e999a92 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 22:52:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-89e4265f-c2a2-405b-ac13-93d86e999a92 None None] Releasing lock "compute-rpcapi-router" {{(pid=61613) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 22:52:53 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-89e4265f-c2a2-405b-ac13-93d86e999a92 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177063 Apr 13 22:52:53 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 20/60] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:52:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:52:53 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-eae553e2-5653-4bcc-9d67-91bb84f2df59 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Action: 'create', calling method: .version_select at 0x7f3d1eb4a0e0>, body: {"keypair": {"name": "tempest-keypair-1288429327", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGG8geDVsN5KCbwanV43dcTPubxsRVV396AawS43lH/1wpzCdySaKQyIvqwEs0J64zhA20KaUXLOqWWWOfH1mvUaY2xH6JXuK78xj0Ln04BXM/n5aZkAdtXlI21Ph3uoA=="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:52:54 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-eae553e2-5653-4bcc-9d67-91bb84f2df59 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting quotas for project 85ccac99656842aca44f9f1eb7aa167a. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:52:54 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-eae553e2-5653-4bcc-9d67-91bb84f2df59 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting quotas for user 98594f3f6ccf4ffdbfd91bcf192d936e and project 85ccac99656842aca44f9f1eb7aa167a. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:52:54 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-eae553e2-5653-4bcc-9d67-91bb84f2df59 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124311 Apr 13 22:52:54 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 20/61] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 22:52:53 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:52:54 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-399970293", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8"}], "security_groups": [{"name": "tempest-securitygroup--620564029"}], "key_name": "tempest-keypair-361428277", "user_data": "}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:52:55 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] validate_networks() for [('a708f18b-3eef-4221-bc1b-e4c90b6c6af8', None, None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:52:55 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1442957850", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:52:55 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] validate_networks() for [('3586c352-7de6-4c50-a421-23f8709105d0', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:52:56 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:52:56 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:52:56 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:52:56 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:52:56 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:52:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:52:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:52:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:52:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:52:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:52:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:52:56 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Getting quotas for project d0648ea953174a8cae6085ac24d92bb1. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:52:56 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Getting quotas for user 13b46af525dd45678b69207e93683ac4 and project d0648ea953174a8cae6085ac24d92bb1. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:52:56 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:52:56 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:52:56 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.872222 Apr 13 22:52:56 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 22/62] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:52:54 2023] POST /compute/v2.1/servers => generated 399 bytes in 1874 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:52:56 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-efe55d63-e137-450b-8187-fd49d3a2c35d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:52:56 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-efe55d63-e137-450b-8187-fd49d3a2c35d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:52:56 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-efe55d63-e137-450b-8187-fd49d3a2c35d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b46af525dd45678b69207e93683ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0648ea953174a8cae6085ac24d92bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:52:56 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-efe55d63-e137-450b-8187-fd49d3a2c35d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b" status: 200 len: 1230 microversion: 2.1 time: 0.125131 Apr 13 22:52:56 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 21/63] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:52:56 2023] GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b => generated 1230 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:52:56 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:52:56 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:52:56 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:52:56 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:52:56 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:52:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:52:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:52:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:52:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:52:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:52:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:52:57 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Getting quotas for project 5b6a1fccc07f4f5a8f8f8617ae03955d. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:52:57 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Getting quotas for user 28cb6d8d6e3d4ef7aa53bb17faf495c4 and project 5b6a1fccc07f4f5a8f8f8617ae03955d. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:52:57 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:52:57 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:52:57 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.945618 Apr 13 22:52:57 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 21/64] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:52:55 2023] POST /compute/v2.1/servers => generated 381 bytes in 1952 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:52:57 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-95452f37-f90f-411a-8d23-e4758afee55d tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:52:57 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-95452f37-f90f-411a-8d23-e4758afee55d tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:52:57 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-95452f37-f90f-411a-8d23-e4758afee55d tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:52:57 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-95452f37-f90f-411a-8d23-e4758afee55d tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555" status: 200 len: 1216 microversion: 2.1 time: 0.102934 Apr 13 22:52:57 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 23/65] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:52:57 2023] GET /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555 => generated 1216 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:52:57 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1927376719", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:52:57 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] validate_networks() for [('3586c352-7de6-4c50-a421-23f8709105d0', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:52:58 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:52:58 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:52:58 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:52:58 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:52:58 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:52:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:52:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:52:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:52:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:52:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:52:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:52:58 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Getting quotas for project 5b6a1fccc07f4f5a8f8f8617ae03955d. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:52:58 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Getting quotas for user 28cb6d8d6e3d4ef7aa53bb17faf495c4 and project 5b6a1fccc07f4f5a8f8f8617ae03955d. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:52:58 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:52:58 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:52:58 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.133440 Apr 13 22:52:58 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 22/66] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:52:57 2023] POST /compute/v2.1/servers => generated 381 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:52:58 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-d36f271b-c90f-413d-b34c-728333624ae0 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:52:58 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-d36f271b-c90f-413d-b34c-728333624ae0 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:52:58 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-d1e62f5a-42fb-4216-8015-f4a595f1065f req-4072a87b-ce81-4ac6-a9ed-e734b5ffb2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "636a69ed-f9b3-4b91-b371-7f7bf3e85154", "tag": "7c255119-87ff-437e-baec-874090c7c7e4"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:52:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d1e62f5a-42fb-4216-8015-f4a595f1065f req-4072a87b-ce81-4ac6-a9ed-e734b5ffb2b2 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:52:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d1e62f5a-42fb-4216-8015-f4a595f1065f req-4072a87b-ce81-4ac6-a9ed-e734b5ffb2b2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:52:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d1e62f5a-42fb-4216-8015-f4a595f1065f req-4072a87b-ce81-4ac6-a9ed-e734b5ffb2b2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:52:58 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-d36f271b-c90f-413d-b34c-728333624ae0 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:52:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-d1e62f5a-42fb-4216-8015-f4a595f1065f req-4072a87b-ce81-4ac6-a9ed-e734b5ffb2b2 service nova] Creating event network-changed:7c255119-87ff-437e-baec-874090c7c7e4 for instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 on user Apr 13 22:52:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d1e62f5a-42fb-4216-8015-f4a595f1065f req-4072a87b-ce81-4ac6-a9ed-e734b5ffb2b2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61611) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 22:52:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d1e62f5a-42fb-4216-8015-f4a595f1065f req-4072a87b-ce81-4ac6-a9ed-e734b5ffb2b2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61611) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 22:52:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8ec47439-7805-4abd-bae0-2e464da120c2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:52:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8ec47439-7805-4abd-bae0-2e464da120c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:52:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8ec47439-7805-4abd-bae0-2e464da120c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:52:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8ec47439-7805-4abd-bae0-2e464da120c2 None None] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:52:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8ec47439-7805-4abd-bae0-2e464da120c2 None None] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:52:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8ec47439-7805-4abd-bae0-2e464da120c2 None None] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:52:58 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-d36f271b-c90f-413d-b34c-728333624ae0 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff417f05-3cfa-4274-a0d9-9145ce1e5f83" status: 200 len: 1216 microversion: 2.1 time: 0.192238 Apr 13 22:52:58 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 22/67] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:52:58 2023] GET /compute/v2.1/servers/ff417f05-3cfa-4274-a0d9-9145ce1e5f83 => generated 1216 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:52:58 user devstack@n-api.service[61611]: INFO nova.compute.rpcapi [None req-8ec47439-7805-4abd-bae0-2e464da120c2 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 22:52:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8ec47439-7805-4abd-bae0-2e464da120c2 None None] Releasing lock "compute-rpcapi-router" {{(pid=61611) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 22:52:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-8ec47439-7805-4abd-bae0-2e464da120c2 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099716 Apr 13 22:52:58 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 24/68] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:52:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:52:59 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-839336931", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf"}], "security_groups": [{"name": "tempest-securitygroup--195477329"}], "key_name": "tempest-keypair-1288429327", "user_data": "}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:52:59 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] validate_networks() for [('d59145a7-f00c-4cd3-ab12-f4b6ae2608cf', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:52:59 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-fd2ddc36-9a0a-453c-b313-72cc0c86dae1 req-f41c7bed-8bc2-4a32-8b81-f37a8d8eab5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f241623-e618-42eb-87d1-0606e37ec499", "name": "network-vif-plugged", "status": "completed", "tag": "87e984d6-f653-4e7e-a230-53cd27a17d97"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:52:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-fd2ddc36-9a0a-453c-b313-72cc0c86dae1 req-f41c7bed-8bc2-4a32-8b81-f37a8d8eab5a service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:52:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-fd2ddc36-9a0a-453c-b313-72cc0c86dae1 req-f41c7bed-8bc2-4a32-8b81-f37a8d8eab5a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:52:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-fd2ddc36-9a0a-453c-b313-72cc0c86dae1 req-f41c7bed-8bc2-4a32-8b81-f37a8d8eab5a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:52:59 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-fd2ddc36-9a0a-453c-b313-72cc0c86dae1 req-f41c7bed-8bc2-4a32-8b81-f37a8d8eab5a service nova] Creating event network-vif-plugged:87e984d6-f653-4e7e-a230-53cd27a17d97 for instance 3f241623-e618-42eb-87d1-0606e37ec499 on user Apr 13 22:52:59 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-fd2ddc36-9a0a-453c-b313-72cc0c86dae1 req-f41c7bed-8bc2-4a32-8b81-f37a8d8eab5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133821 Apr 13 22:52:59 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 23/69] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:52:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:00 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:53:00 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:53:00 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:53:00 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:53:00 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:53:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:01 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting quotas for project 85ccac99656842aca44f9f1eb7aa167a. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:53:01 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting quotas for user 98594f3f6ccf4ffdbfd91bcf192d936e and project 85ccac99656842aca44f9f1eb7aa167a. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:53:01 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:53:01 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:53:01 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.796519 Apr 13 22:53:01 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 23/70] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:52:59 2023] POST /compute/v2.1/servers => generated 399 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:53:01 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-3392e344-caa5-46ca-a319-180a60f989f1 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:53:01 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-3392e344-caa5-46ca-a319-180a60f989f1 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:53:01 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-3392e344-caa5-46ca-a319-180a60f989f1 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98594f3f6ccf4ffdbfd91bcf192d936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ccac99656842aca44f9f1eb7aa167a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:53:01 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-3392e344-caa5-46ca-a319-180a60f989f1 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63" status: 200 len: 1235 microversion: 2.1 time: 0.140945 Apr 13 22:53:01 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 25/71] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:53:01 2023] GET /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63 => generated 1235 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:53:02 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-8381a7d6-af8d-409c-8fce-11799889d2ec req-9bab6e68-f9ed-4b32-abad-2bdac31c96a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f241623-e618-42eb-87d1-0606e37ec499", "name": "network-vif-plugged", "status": "completed", "tag": "87e984d6-f653-4e7e-a230-53cd27a17d97"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8381a7d6-af8d-409c-8fce-11799889d2ec req-9bab6e68-f9ed-4b32-abad-2bdac31c96a8 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8381a7d6-af8d-409c-8fce-11799889d2ec req-9bab6e68-f9ed-4b32-abad-2bdac31c96a8 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8381a7d6-af8d-409c-8fce-11799889d2ec req-9bab6e68-f9ed-4b32-abad-2bdac31c96a8 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-8381a7d6-af8d-409c-8fce-11799889d2ec req-9bab6e68-f9ed-4b32-abad-2bdac31c96a8 service nova] Creating event network-vif-plugged:87e984d6-f653-4e7e-a230-53cd27a17d97 for instance 3f241623-e618-42eb-87d1-0606e37ec499 on user Apr 13 22:53:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-8381a7d6-af8d-409c-8fce-11799889d2ec req-9bab6e68-f9ed-4b32-abad-2bdac31c96a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079582 Apr 13 22:53:02 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 24/72] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:53:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:02 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-f49d0ad3-0aa3-4a38-8dc3-a6d6a17503c6 req-224ffe85-c3c5-4919-83d4-90208119f52b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636a69ed-f9b3-4b91-b371-7f7bf3e85154", "name": "network-vif-plugged", "status": "completed", "tag": "7c255119-87ff-437e-baec-874090c7c7e4"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f49d0ad3-0aa3-4a38-8dc3-a6d6a17503c6 req-224ffe85-c3c5-4919-83d4-90208119f52b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f49d0ad3-0aa3-4a38-8dc3-a6d6a17503c6 req-224ffe85-c3c5-4919-83d4-90208119f52b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f49d0ad3-0aa3-4a38-8dc3-a6d6a17503c6 req-224ffe85-c3c5-4919-83d4-90208119f52b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f49d0ad3-0aa3-4a38-8dc3-a6d6a17503c6 req-224ffe85-c3c5-4919-83d4-90208119f52b service nova] Creating event network-vif-plugged:7c255119-87ff-437e-baec-874090c7c7e4 for instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 on user Apr 13 22:53:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f49d0ad3-0aa3-4a38-8dc3-a6d6a17503c6 req-224ffe85-c3c5-4919-83d4-90208119f52b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61612) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 22:53:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f49d0ad3-0aa3-4a38-8dc3-a6d6a17503c6 req-224ffe85-c3c5-4919-83d4-90208119f52b service nova] Acquired lock "compute-rpcapi-router" {{(pid=61612) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 22:53:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5b02b532-f0da-4d8d-b277-02638f398b72 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5b02b532-f0da-4d8d-b277-02638f398b72 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5b02b532-f0da-4d8d-b277-02638f398b72 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5b02b532-f0da-4d8d-b277-02638f398b72 None None] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5b02b532-f0da-4d8d-b277-02638f398b72 None None] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5b02b532-f0da-4d8d-b277-02638f398b72 None None] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:02 user devstack@n-api.service[61612]: INFO nova.compute.rpcapi [None req-5b02b532-f0da-4d8d-b277-02638f398b72 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 22:53:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5b02b532-f0da-4d8d-b277-02638f398b72 None None] Releasing lock "compute-rpcapi-router" {{(pid=61612) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 22:53:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-5b02b532-f0da-4d8d-b277-02638f398b72 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140170 Apr 13 22:53:02 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 24/73] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:53:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-cc8ca463-0202-4cd2-bd66-2a62cbd8752b req-1314ebba-9e4d-44b5-9090-40518613a0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df12dd8d-ea02-4c59-804d-52ae1bd4a555", "tag": "6566345e-be68-4eb1-90de-e53780e7f8f9"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-cc8ca463-0202-4cd2-bd66-2a62cbd8752b req-1314ebba-9e4d-44b5-9090-40518613a0c5 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-cc8ca463-0202-4cd2-bd66-2a62cbd8752b req-1314ebba-9e4d-44b5-9090-40518613a0c5 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-cc8ca463-0202-4cd2-bd66-2a62cbd8752b req-1314ebba-9e4d-44b5-9090-40518613a0c5 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:04 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-cc8ca463-0202-4cd2-bd66-2a62cbd8752b req-1314ebba-9e4d-44b5-9090-40518613a0c5 service nova] Creating event network-changed:6566345e-be68-4eb1-90de-e53780e7f8f9 for instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 on user Apr 13 22:53:04 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-cc8ca463-0202-4cd2-bd66-2a62cbd8752b req-1314ebba-9e4d-44b5-9090-40518613a0c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241531 Apr 13 22:53:04 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 26/74] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:53:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:04 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-db72035f-d3d4-4553-b3d4-f9e4f1c08478 req-c61ea0bc-76be-4c3f-ba5e-37bbf264a320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636a69ed-f9b3-4b91-b371-7f7bf3e85154", "name": "network-vif-plugged", "status": "completed", "tag": "7c255119-87ff-437e-baec-874090c7c7e4"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-db72035f-d3d4-4553-b3d4-f9e4f1c08478 req-c61ea0bc-76be-4c3f-ba5e-37bbf264a320 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-db72035f-d3d4-4553-b3d4-f9e4f1c08478 req-c61ea0bc-76be-4c3f-ba5e-37bbf264a320 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-db72035f-d3d4-4553-b3d4-f9e4f1c08478 req-c61ea0bc-76be-4c3f-ba5e-37bbf264a320 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:04 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-db72035f-d3d4-4553-b3d4-f9e4f1c08478 req-c61ea0bc-76be-4c3f-ba5e-37bbf264a320 service nova] Creating event network-vif-plugged:7c255119-87ff-437e-baec-874090c7c7e4 for instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 on user Apr 13 22:53:04 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-db72035f-d3d4-4553-b3d4-f9e4f1c08478 req-c61ea0bc-76be-4c3f-ba5e-37bbf264a320 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105410 Apr 13 22:53:04 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 25/75] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:53:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:06 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-ac8751a7-c27e-4a3b-8e79-7c46f93e8fac tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Action: 'create', calling method: .version_select at 0x7f3d1eb9e950>, body: {"keypair": {"name": "tempest-keypair-686921666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObF04qfQe1XUBpXGnJngmDi1GmEIreN0d0ZxA7hkpzFUTJv86Fr4EfbN4NCxkHRaIN2RUxi8ku3mcOnyyqemReBiK8NwWityhFwwbgBqfpTW9dedeBA81mDCVtDqQo2+A=="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:07 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-ac8751a7-c27e-4a3b-8e79-7c46f93e8fac tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Getting quotas for project a33cf3bf67714b0ba9c7f703a1c9e5b9. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:53:07 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-ac8751a7-c27e-4a3b-8e79-7c46f93e8fac tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Getting quotas for user e1b08dea04784bc3b07195f951a84bfb and project a33cf3bf67714b0ba9c7f703a1c9e5b9. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:53:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-ac8751a7-c27e-4a3b-8e79-7c46f93e8fac tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.582864 Apr 13 22:53:07 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 25/76] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 22:53:06 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:07 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-5b3819bb-fa26-4950-83c6-464f384d5010 req-af485391-1c98-420a-b85b-1ae262403fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92e1fa88-8896-4198-af4d-56d44baf3b9b", "tag": "94c47f47-2ee7-46d0-858d-a5ff3270a80b"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5b3819bb-fa26-4950-83c6-464f384d5010 req-af485391-1c98-420a-b85b-1ae262403fe4 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5b3819bb-fa26-4950-83c6-464f384d5010 req-af485391-1c98-420a-b85b-1ae262403fe4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5b3819bb-fa26-4950-83c6-464f384d5010 req-af485391-1c98-420a-b85b-1ae262403fe4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:07 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-5b3819bb-fa26-4950-83c6-464f384d5010 req-af485391-1c98-420a-b85b-1ae262403fe4 service nova] Creating event network-changed:94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b on user Apr 13 22:53:07 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-5b3819bb-fa26-4950-83c6-464f384d5010 req-af485391-1c98-420a-b85b-1ae262403fe4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059246 Apr 13 22:53:07 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 27/77] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:53:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 22:53:07 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:07 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-5abf8eff-ff0d-44a2-a191-d5e46ded092e req-666e7bf8-1aea-4521-956e-89aadc01157c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df12dd8d-ea02-4c59-804d-52ae1bd4a555", "name": "network-vif-plugged", "status": "completed", "tag": "6566345e-be68-4eb1-90de-e53780e7f8f9"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-5abf8eff-ff0d-44a2-a191-d5e46ded092e req-666e7bf8-1aea-4521-956e-89aadc01157c service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-5abf8eff-ff0d-44a2-a191-d5e46ded092e req-666e7bf8-1aea-4521-956e-89aadc01157c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-5abf8eff-ff0d-44a2-a191-d5e46ded092e req-666e7bf8-1aea-4521-956e-89aadc01157c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:07 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-5abf8eff-ff0d-44a2-a191-d5e46ded092e req-666e7bf8-1aea-4521-956e-89aadc01157c service nova] Creating event network-vif-plugged:6566345e-be68-4eb1-90de-e53780e7f8f9 for instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 on user Apr 13 22:53:07 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-5abf8eff-ff0d-44a2-a191-d5e46ded092e req-666e7bf8-1aea-4521-956e-89aadc01157c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056178 Apr 13 22:53:07 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 26/78] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:53:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:09 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-5d543004-b2ff-4f1b-b5fa-141f4a070321 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Action: 'create', calling method: .version_select at 0x7f3d1eb9feb0>, body: {"keypair": {"name": "tempest-keypair-864897906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXj02oyoksF1tjWwSgW0skVN3juez2TfkFa4tY4tvPDRSVTwcYPTRDAeB0p5mOsILnlocO3X8FdWawd/NGV/BrUcM9pknOVivGHz3Nhsk+gPH86ILA1HHLQ+H7QpdJ33A=="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:09 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=14 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:09 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-5d543004-b2ff-4f1b-b5fa-141f4a070321 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Getting quotas for project cc753ebae6474a4b8a914b240795df82. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:53:09 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-5d543004-b2ff-4f1b-b5fa-141f4a070321 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Getting quotas for user d624ba67e327453881558410a112910a and project cc753ebae6474a4b8a914b240795df82. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:53:09 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-5d543004-b2ff-4f1b-b5fa-141f4a070321 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.608629 Apr 13 22:53:09 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 26/79] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 22:53:08 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:09 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-3a9d048f-be6b-4531-9d3f-e851fb2ef442 req-cda9299d-8168-49d9-990d-f2ca412a370f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff417f05-3cfa-4274-a0d9-9145ce1e5f83", "tag": "ac600f3d-8b2c-4200-81dd-3d35843d3f28"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:09 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-3a9d048f-be6b-4531-9d3f-e851fb2ef442 req-cda9299d-8168-49d9-990d-f2ca412a370f service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-3a9d048f-be6b-4531-9d3f-e851fb2ef442 req-cda9299d-8168-49d9-990d-f2ca412a370f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-3a9d048f-be6b-4531-9d3f-e851fb2ef442 req-cda9299d-8168-49d9-990d-f2ca412a370f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:09 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-3a9d048f-be6b-4531-9d3f-e851fb2ef442 req-cda9299d-8168-49d9-990d-f2ca412a370f service nova] Creating event network-changed:ac600f3d-8b2c-4200-81dd-3d35843d3f28 for instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 on user Apr 13 22:53:09 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-3a9d048f-be6b-4531-9d3f-e851fb2ef442 req-cda9299d-8168-49d9-990d-f2ca412a370f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121425 Apr 13 22:53:09 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 28/80] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:53:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 22:53:09 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=12 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:09 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-abe2da77-5fbd-4c93-8005-0d175e8f8c23 req-79e4a7db-628e-4e4b-b6be-0312d18080ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df12dd8d-ea02-4c59-804d-52ae1bd4a555", "name": "network-vif-plugged", "status": "completed", "tag": "6566345e-be68-4eb1-90de-e53780e7f8f9"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-abe2da77-5fbd-4c93-8005-0d175e8f8c23 req-79e4a7db-628e-4e4b-b6be-0312d18080ff service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-abe2da77-5fbd-4c93-8005-0d175e8f8c23 req-79e4a7db-628e-4e4b-b6be-0312d18080ff service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-abe2da77-5fbd-4c93-8005-0d175e8f8c23 req-79e4a7db-628e-4e4b-b6be-0312d18080ff service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:09 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-abe2da77-5fbd-4c93-8005-0d175e8f8c23 req-79e4a7db-628e-4e4b-b6be-0312d18080ff service nova] Creating event network-vif-plugged:6566345e-be68-4eb1-90de-e53780e7f8f9 for instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 on user Apr 13 22:53:09 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-abe2da77-5fbd-4c93-8005-0d175e8f8c23 req-79e4a7db-628e-4e4b-b6be-0312d18080ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039672 Apr 13 22:53:09 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 27/81] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:53:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:10 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1789468832", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "networks": [{"uuid": "778950f1-e25a-4ca7-923c-d73459c36663"}], "security_groups": [{"name": "tempest-securitygroup--240700338"}], "key_name": "tempest-keypair-686921666", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:11 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] validate_networks() for [('778950f1-e25a-4ca7-923c-d73459c36663', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:53:12 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=14 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:12 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-635eaea2-8954-4603-9928-f82abd3c85b8 req-6cef8da5-a558-4684-8d53-9e83f25b1b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e1fa88-8896-4198-af4d-56d44baf3b9b", "name": "network-vif-plugged", "status": "completed", "tag": "94c47f47-2ee7-46d0-858d-a5ff3270a80b"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:12 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-635eaea2-8954-4603-9928-f82abd3c85b8 req-6cef8da5-a558-4684-8d53-9e83f25b1b54 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:12 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-635eaea2-8954-4603-9928-f82abd3c85b8 req-6cef8da5-a558-4684-8d53-9e83f25b1b54 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:12 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-635eaea2-8954-4603-9928-f82abd3c85b8 req-6cef8da5-a558-4684-8d53-9e83f25b1b54 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:12 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-635eaea2-8954-4603-9928-f82abd3c85b8 req-6cef8da5-a558-4684-8d53-9e83f25b1b54 service nova] Creating event network-vif-plugged:94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b on user Apr 13 22:53:12 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-635eaea2-8954-4603-9928-f82abd3c85b8 req-6cef8da5-a558-4684-8d53-9e83f25b1b54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093200 Apr 13 22:53:12 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 29/82] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:53:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:12 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-42c9078b-0613-4ca1-8153-a8f70f9d298a req-0e8072ed-67b2-4bf0-bf7c-f9c99ab23f33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e10dfa7-4997-44b0-b26d-421c7a2d8b63", "tag": "822bdb49-5f9a-4949-8543-929b1764e810"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-42c9078b-0613-4ca1-8153-a8f70f9d298a req-0e8072ed-67b2-4bf0-bf7c-f9c99ab23f33 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-42c9078b-0613-4ca1-8153-a8f70f9d298a req-0e8072ed-67b2-4bf0-bf7c-f9c99ab23f33 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-42c9078b-0613-4ca1-8153-a8f70f9d298a req-0e8072ed-67b2-4bf0-bf7c-f9c99ab23f33 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:12 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-42c9078b-0613-4ca1-8153-a8f70f9d298a req-0e8072ed-67b2-4bf0-bf7c-f9c99ab23f33 service nova] Creating event network-changed:822bdb49-5f9a-4949-8543-929b1764e810 for instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 on user Apr 13 22:53:12 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-42c9078b-0613-4ca1-8153-a8f70f9d298a req-0e8072ed-67b2-4bf0-bf7c-f9c99ab23f33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062473 Apr 13 22:53:12 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 28/83] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:53:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:12 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=10 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:12 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=12 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:12 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:53:12 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:53:12 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:53:12 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:53:12 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:53:13 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=39 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:13 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Getting quotas for project a33cf3bf67714b0ba9c7f703a1c9e5b9. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:53:13 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Getting quotas for user e1b08dea04784bc3b07195f951a84bfb and project a33cf3bf67714b0ba9c7f703a1c9e5b9. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:53:13 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:53:13 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:53:13 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.630220 Apr 13 22:53:13 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 27/84] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:53:10 2023] POST /compute/v2.1/servers => generated 403 bytes in 2634 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:53:13 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-347a3fb1-817e-41ee-8f16-b2a736264ff9 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:53:13 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-347a3fb1-817e-41ee-8f16-b2a736264ff9 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:53:13 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:13 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-347a3fb1-817e-41ee-8f16-b2a736264ff9 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b08dea04784bc3b07195f951a84bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33cf3bf67714b0ba9c7f703a1c9e5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:53:13 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-347a3fb1-817e-41ee-8f16-b2a736264ff9 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063" status: 200 len: 1235 microversion: 2.1 time: 0.188671 Apr 13 22:53:13 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 30/85] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:53:13 2023] GET /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063 => generated 1235 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:53:14 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e1fa88-8896-4198-af4d-56d44baf3b9b", "name": "network-vif-plugged", "status": "completed", "tag": "94c47f47-2ee7-46d0-858d-a5ff3270a80b"}, {"server_uuid": "ff417f05-3cfa-4274-a0d9-9145ce1e5f83", "name": "network-vif-plugged", "status": "completed", "tag": "ac600f3d-8b2c-4200-81dd-3d35843d3f28"}, {"server_uuid": "ff417f05-3cfa-4274-a0d9-9145ce1e5f83", "name": "network-vif-plugged", "status": "completed", "tag": "ac600f3d-8b2c-4200-81dd-3d35843d3f28"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:14 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] Creating event network-vif-plugged:94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b on user Apr 13 22:53:14 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] Creating event network-vif-plugged:ac600f3d-8b2c-4200-81dd-3d35843d3f28 for instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 on user Apr 13 22:53:14 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] Creating event network-vif-plugged:ac600f3d-8b2c-4200-81dd-3d35843d3f28 for instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 on user Apr 13 22:53:14 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.086514 Apr 13 22:53:14 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 29/86] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:53:14 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:14 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1988745821", "imageRef": "23f6496f-7550-41f3-a9ce-a6e787316117", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "481c29af-0d84-43d7-af50-9139d1ff6ce2"}], "security_groups": [{"name": "tempest-securitygroup--2043130125"}], "key_name": "tempest-keypair-864897906", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:14 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] validate_networks() for [('481c29af-0d84-43d7-af50-9139d1ff6ce2', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:53:15 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:53:15 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:53:15 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:53:15 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:53:15 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:53:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:15 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Getting quotas for project cc753ebae6474a4b8a914b240795df82. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:53:15 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Getting quotas for user d624ba67e327453881558410a112910a and project cc753ebae6474a4b8a914b240795df82. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:53:15 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:53:15 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='23f6496f-7550-41f3-a9ce-a6e787316117',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:53:15 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.374593 Apr 13 22:53:15 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 28/87] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:53:14 2023] POST /compute/v2.1/servers => generated 404 bytes in 1378 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:53:15 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-95d966db-34ce-4c27-a7db-888c99c7b2bd tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:53:15 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-95d966db-34ce-4c27-a7db-888c99c7b2bd tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:53:16 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-95d966db-34ce-4c27-a7db-888c99c7b2bd tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd624ba67e327453881558410a112910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc753ebae6474a4b8a914b240795df82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:53:16 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-95d966db-34ce-4c27-a7db-888c99c7b2bd tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab" status: 200 len: 1239 microversion: 2.1 time: 0.178089 Apr 13 22:53:16 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 31/88] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:53:15 2023] GET /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab => generated 1239 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:53:16 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-7090131c-4c95-4bae-ac29-27249fd3bc0c req-b222fc64-7b8c-4294-9889-d60e9eb0bb85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e10dfa7-4997-44b0-b26d-421c7a2d8b63", "name": "network-vif-plugged", "status": "completed", "tag": "822bdb49-5f9a-4949-8543-929b1764e810"}, {"server_uuid": "0e10dfa7-4997-44b0-b26d-421c7a2d8b63", "name": "network-vif-plugged", "status": "completed", "tag": "822bdb49-5f9a-4949-8543-929b1764e810"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-7090131c-4c95-4bae-ac29-27249fd3bc0c req-b222fc64-7b8c-4294-9889-d60e9eb0bb85 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-7090131c-4c95-4bae-ac29-27249fd3bc0c req-b222fc64-7b8c-4294-9889-d60e9eb0bb85 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-7090131c-4c95-4bae-ac29-27249fd3bc0c req-b222fc64-7b8c-4294-9889-d60e9eb0bb85 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-7090131c-4c95-4bae-ac29-27249fd3bc0c req-b222fc64-7b8c-4294-9889-d60e9eb0bb85 service nova] Creating event network-vif-plugged:822bdb49-5f9a-4949-8543-929b1764e810 for instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 on user Apr 13 22:53:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-7090131c-4c95-4bae-ac29-27249fd3bc0c req-b222fc64-7b8c-4294-9889-d60e9eb0bb85 service nova] Creating event network-vif-plugged:822bdb49-5f9a-4949-8543-929b1764e810 for instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 on user Apr 13 22:53:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-7090131c-4c95-4bae-ac29-27249fd3bc0c req-b222fc64-7b8c-4294-9889-d60e9eb0bb85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.085709 Apr 13 22:53:16 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 30/89] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:53:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:18 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-fdec2ef1-a8c6-460b-b8fc-b0b3579587ea req-fbaae06f-e472-4853-8b47-2ec2b81d51fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2355fe9d-511a-4e7c-ac2a-5bddc034e063", "tag": "3958622e-6a70-4931-b630-26e0a53c5755"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-fdec2ef1-a8c6-460b-b8fc-b0b3579587ea req-fbaae06f-e472-4853-8b47-2ec2b81d51fb service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-fdec2ef1-a8c6-460b-b8fc-b0b3579587ea req-fbaae06f-e472-4853-8b47-2ec2b81d51fb service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-fdec2ef1-a8c6-460b-b8fc-b0b3579587ea req-fbaae06f-e472-4853-8b47-2ec2b81d51fb service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:18 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-fdec2ef1-a8c6-460b-b8fc-b0b3579587ea req-fbaae06f-e472-4853-8b47-2ec2b81d51fb service nova] Creating event network-changed:3958622e-6a70-4931-b630-26e0a53c5755 for instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 on user Apr 13 22:53:18 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-fdec2ef1-a8c6-460b-b8fc-b0b3579587ea req-fbaae06f-e472-4853-8b47-2ec2b81d51fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115046 Apr 13 22:53:18 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 29/90] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:53:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:20 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b6574397-9e54-441a-8822-cf59726cb39f tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Action: 'create', calling method: .version_select at 0x7f3d1ebcd6c0>, body: {"keypair": {"name": "tempest-keypair-2139033731", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/rpH+TiQwOSAqxTgoxwVRyx6Xsj2Nna6t2S66aajDjD8Allx8sB6ScX+MnwX9OU0lN861st5YAbEYWblv9K5uoyp9FWTta6tO5LPbohE9CGSW6ew7DKfx9QVGP5Xsfcw=="}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:20 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-b6574397-9e54-441a-8822-cf59726cb39f tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Getting quotas for project 3f871045289a43d18b339d3dac4d0666. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:53:20 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-b6574397-9e54-441a-8822-cf59726cb39f tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Getting quotas for user 20751f66f6564d04807dc09a675aef70 and project 3f871045289a43d18b339d3dac4d0666. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:53:20 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-b6574397-9e54-441a-8822-cf59726cb39f tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.195732 Apr 13 22:53:20 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 32/91] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 22:53:20 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:22 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-18ea2071-3125-4d2c-bf32-dc2c64069e26 req-cdb7542b-7f53-49f5-9675-0fcf494d6182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8400cd0-5a21-4ca5-a4b6-1683897941ab", "tag": "444b360c-4e8d-4075-a10a-dca6e73083b0"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:22 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-18ea2071-3125-4d2c-bf32-dc2c64069e26 req-cdb7542b-7f53-49f5-9675-0fcf494d6182 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-18ea2071-3125-4d2c-bf32-dc2c64069e26 req-cdb7542b-7f53-49f5-9675-0fcf494d6182 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-18ea2071-3125-4d2c-bf32-dc2c64069e26 req-cdb7542b-7f53-49f5-9675-0fcf494d6182 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:22 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=23 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-18ea2071-3125-4d2c-bf32-dc2c64069e26 req-cdb7542b-7f53-49f5-9675-0fcf494d6182 service nova] Creating event network-changed:444b360c-4e8d-4075-a10a-dca6e73083b0 for instance b8400cd0-5a21-4ca5-a4b6-1683897941ab on user Apr 13 22:53:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-18ea2071-3125-4d2c-bf32-dc2c64069e26 req-cdb7542b-7f53-49f5-9675-0fcf494d6182 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060331 Apr 13 22:53:22 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 31/92] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:53:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 22:53:23 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-519422002", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "networks": [{"uuid": "cec66c14-1035-4217-905f-2797d42000d8"}], "security_groups": [{"name": "tempest-securitygroup--667347311"}], "key_name": "tempest-keypair-2139033731", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:23 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] validate_networks() for [('cec66c14-1035-4217-905f-2797d42000d8', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:53:24 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:53:24 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:53:24 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:53:24 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:53:24 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:53:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:24 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Getting quotas for project 3f871045289a43d18b339d3dac4d0666. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:53:24 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Getting quotas for user 20751f66f6564d04807dc09a675aef70 and project 3f871045289a43d18b339d3dac4d0666. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:53:24 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:53:24 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:53:24 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.970102 Apr 13 22:53:24 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 30/93] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:53:23 2023] POST /compute/v2.1/servers => generated 403 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:53:24 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=14 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:24 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-137fcda1-eccc-4fa4-8e36-d49bd653826a tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:53:24 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-137fcda1-eccc-4fa4-8e36-d49bd653826a tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:53:24 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-137fcda1-eccc-4fa4-8e36-d49bd653826a tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20751f66f6564d04807dc09a675aef70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f871045289a43d18b339d3dac4d0666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:53:24 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-137fcda1-eccc-4fa4-8e36-d49bd653826a tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128" status: 200 len: 1225 microversion: 2.1 time: 0.147095 Apr 13 22:53:24 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 33/94] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:53:24 2023] GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128 => generated 1225 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:53:24 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-709feaa0-fa57-490c-8e33-d0bc13f7c3fd req-fd224e26-dd43-49c7-bbf7-456c79a201d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2355fe9d-511a-4e7c-ac2a-5bddc034e063", "name": "network-vif-plugged", "status": "completed", "tag": "3958622e-6a70-4931-b630-26e0a53c5755"}, {"server_uuid": "2355fe9d-511a-4e7c-ac2a-5bddc034e063", "name": "network-vif-plugged", "status": "completed", "tag": "3958622e-6a70-4931-b630-26e0a53c5755"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-709feaa0-fa57-490c-8e33-d0bc13f7c3fd req-fd224e26-dd43-49c7-bbf7-456c79a201d1 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-709feaa0-fa57-490c-8e33-d0bc13f7c3fd req-fd224e26-dd43-49c7-bbf7-456c79a201d1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-709feaa0-fa57-490c-8e33-d0bc13f7c3fd req-fd224e26-dd43-49c7-bbf7-456c79a201d1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:24 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-709feaa0-fa57-490c-8e33-d0bc13f7c3fd req-fd224e26-dd43-49c7-bbf7-456c79a201d1 service nova] Creating event network-vif-plugged:3958622e-6a70-4931-b630-26e0a53c5755 for instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 on user Apr 13 22:53:24 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-709feaa0-fa57-490c-8e33-d0bc13f7c3fd req-fd224e26-dd43-49c7-bbf7-456c79a201d1 service nova] Creating event network-vif-plugged:3958622e-6a70-4931-b630-26e0a53c5755 for instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 on user Apr 13 22:53:24 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-709feaa0-fa57-490c-8e33-d0bc13f7c3fd req-fd224e26-dd43-49c7-bbf7-456c79a201d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.087126 Apr 13 22:53:24 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 32/95] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:53:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-7c744429-8994-4ddb-bf5d-427466f72a33 req-fc15f035-1980-4b0f-8f8e-9ceb54065cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8400cd0-5a21-4ca5-a4b6-1683897941ab", "name": "network-vif-plugged", "status": "completed", "tag": "444b360c-4e8d-4075-a10a-dca6e73083b0"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7c744429-8994-4ddb-bf5d-427466f72a33 req-fc15f035-1980-4b0f-8f8e-9ceb54065cc8 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7c744429-8994-4ddb-bf5d-427466f72a33 req-fc15f035-1980-4b0f-8f8e-9ceb54065cc8 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7c744429-8994-4ddb-bf5d-427466f72a33 req-fc15f035-1980-4b0f-8f8e-9ceb54065cc8 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-7c744429-8994-4ddb-bf5d-427466f72a33 req-fc15f035-1980-4b0f-8f8e-9ceb54065cc8 service nova] Creating event network-vif-plugged:444b360c-4e8d-4075-a10a-dca6e73083b0 for instance b8400cd0-5a21-4ca5-a4b6-1683897941ab on user Apr 13 22:53:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-7c744429-8994-4ddb-bf5d-427466f72a33 req-fc15f035-1980-4b0f-8f8e-9ceb54065cc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063266 Apr 13 22:53:27 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 31/96] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:53:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:28 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-f76417d9-590d-47e5-adb4-909b733e2dea req-ccfcd7ec-6dad-4b7e-baea-62f39f98c14d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d246d08-7efe-4307-8a37-32f4c0621128", "tag": "603de7bb-7bac-4b93-b74f-d51fb87ffe46"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f76417d9-590d-47e5-adb4-909b733e2dea req-ccfcd7ec-6dad-4b7e-baea-62f39f98c14d service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f76417d9-590d-47e5-adb4-909b733e2dea req-ccfcd7ec-6dad-4b7e-baea-62f39f98c14d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f76417d9-590d-47e5-adb4-909b733e2dea req-ccfcd7ec-6dad-4b7e-baea-62f39f98c14d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:28 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-f76417d9-590d-47e5-adb4-909b733e2dea req-ccfcd7ec-6dad-4b7e-baea-62f39f98c14d service nova] Creating event network-changed:603de7bb-7bac-4b93-b74f-d51fb87ffe46 for instance 3d246d08-7efe-4307-8a37-32f4c0621128 on user Apr 13 22:53:28 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-f76417d9-590d-47e5-adb4-909b733e2dea req-ccfcd7ec-6dad-4b7e-baea-62f39f98c14d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051258 Apr 13 22:53:28 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 34/97] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:53:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:29 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-7bcea8b6-3bd0-4031-963f-668f4f524fef req-a45099a0-3c41-485f-945d-933c56f21f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8400cd0-5a21-4ca5-a4b6-1683897941ab", "name": "network-vif-plugged", "status": "completed", "tag": "444b360c-4e8d-4075-a10a-dca6e73083b0"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-7bcea8b6-3bd0-4031-963f-668f4f524fef req-a45099a0-3c41-485f-945d-933c56f21f80 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-7bcea8b6-3bd0-4031-963f-668f4f524fef req-a45099a0-3c41-485f-945d-933c56f21f80 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-7bcea8b6-3bd0-4031-963f-668f4f524fef req-a45099a0-3c41-485f-945d-933c56f21f80 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:29 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-7bcea8b6-3bd0-4031-963f-668f4f524fef req-a45099a0-3c41-485f-945d-933c56f21f80 service nova] Creating event network-vif-plugged:444b360c-4e8d-4075-a10a-dca6e73083b0 for instance b8400cd0-5a21-4ca5-a4b6-1683897941ab on user Apr 13 22:53:29 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-7bcea8b6-3bd0-4031-963f-668f4f524fef req-a45099a0-3c41-485f-945d-933c56f21f80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041545 Apr 13 22:53:29 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 33/98] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:53:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-a83fd427-9188-4a31-9ed6-c7ac1fcb391c req-13d03264-1577-4cbd-81e9-4eb08bd9a10b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d246d08-7efe-4307-8a37-32f4c0621128", "name": "network-vif-plugged", "status": "completed", "tag": "603de7bb-7bac-4b93-b74f-d51fb87ffe46"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a83fd427-9188-4a31-9ed6-c7ac1fcb391c req-13d03264-1577-4cbd-81e9-4eb08bd9a10b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a83fd427-9188-4a31-9ed6-c7ac1fcb391c req-13d03264-1577-4cbd-81e9-4eb08bd9a10b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a83fd427-9188-4a31-9ed6-c7ac1fcb391c req-13d03264-1577-4cbd-81e9-4eb08bd9a10b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:32 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-a83fd427-9188-4a31-9ed6-c7ac1fcb391c req-13d03264-1577-4cbd-81e9-4eb08bd9a10b service nova] Creating event network-vif-plugged:603de7bb-7bac-4b93-b74f-d51fb87ffe46 for instance 3d246d08-7efe-4307-8a37-32f4c0621128 on user Apr 13 22:53:32 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-a83fd427-9188-4a31-9ed6-c7ac1fcb391c req-13d03264-1577-4cbd-81e9-4eb08bd9a10b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115808 Apr 13 22:53:32 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 32/99] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:53:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:33 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-a005938d-856f-4586-81d0-6a7020c883ac tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:53:33 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-a005938d-856f-4586-81d0-6a7020c883ac tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:53:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a005938d-856f-4586-81d0-6a7020c883ac tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a005938d-856f-4586-81d0-6a7020c883ac tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a005938d-856f-4586-81d0-6a7020c883ac tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a005938d-856f-4586-81d0-6a7020c883ac tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a005938d-856f-4586-81d0-6a7020c883ac tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a005938d-856f-4586-81d0-6a7020c883ac tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:33 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-a005938d-856f-4586-81d0-6a7020c883ac tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03ab225421441098f94350bef24442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd502d982f4fe424a8df8149962d46963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:53:33 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-a005938d-856f-4586-81d0-6a7020c883ac tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499" status: 200 len: 1550 microversion: 2.1 time: 0.501841 Apr 13 22:53:33 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 35/100] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:53:33 2023] GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499 => generated 1550 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:53:34 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-b6ce543c-7900-47cc-901d-fa85458e3825 req-98c0b962-e17f-4220-8e5a-a206cc7d7e54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d246d08-7efe-4307-8a37-32f4c0621128", "name": "network-vif-plugged", "status": "completed", "tag": "603de7bb-7bac-4b93-b74f-d51fb87ffe46"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:53:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-b6ce543c-7900-47cc-901d-fa85458e3825 req-98c0b962-e17f-4220-8e5a-a206cc7d7e54 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-b6ce543c-7900-47cc-901d-fa85458e3825 req-98c0b962-e17f-4220-8e5a-a206cc7d7e54 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-b6ce543c-7900-47cc-901d-fa85458e3825 req-98c0b962-e17f-4220-8e5a-a206cc7d7e54 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:34 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-b6ce543c-7900-47cc-901d-fa85458e3825 req-98c0b962-e17f-4220-8e5a-a206cc7d7e54 service nova] Creating event network-vif-plugged:603de7bb-7bac-4b93-b74f-d51fb87ffe46 for instance 3d246d08-7efe-4307-8a37-32f4c0621128 on user Apr 13 22:53:34 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-b6ce543c-7900-47cc-901d-fa85458e3825 req-98c0b962-e17f-4220-8e5a-a206cc7d7e54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073855 Apr 13 22:53:34 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 34/101] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:53:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:53:41 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-208d4127-d55c-4987-847d-c64ab9356067 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:53:41 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-208d4127-d55c-4987-847d-c64ab9356067 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:53:41 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:41 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=17 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:41 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=10 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-208d4127-d55c-4987-847d-c64ab9356067 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-208d4127-d55c-4987-847d-c64ab9356067 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-208d4127-d55c-4987-847d-c64ab9356067 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-208d4127-d55c-4987-847d-c64ab9356067 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-208d4127-d55c-4987-847d-c64ab9356067 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-208d4127-d55c-4987-847d-c64ab9356067 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:41 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-208d4127-d55c-4987-847d-c64ab9356067 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd77e681f9467db86ff56ff8f516b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c86d23c9fa4c60b53700b0798a215f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:53:41 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-208d4127-d55c-4987-847d-c64ab9356067 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154" status: 200 len: 1489 microversion: 2.1 time: 0.296281 Apr 13 22:53:41 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 33/102] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:53:41 2023] GET /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154 => generated 1489 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 22:53:46 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-025fef2f-3123-405f-93b8-ddc117b7385a tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:53:46 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-025fef2f-3123-405f-93b8-ddc117b7385a tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:53:46 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=10 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:46 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:46 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=8 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-025fef2f-3123-405f-93b8-ddc117b7385a tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-025fef2f-3123-405f-93b8-ddc117b7385a tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-025fef2f-3123-405f-93b8-ddc117b7385a tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-025fef2f-3123-405f-93b8-ddc117b7385a tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-025fef2f-3123-405f-93b8-ddc117b7385a tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-025fef2f-3123-405f-93b8-ddc117b7385a tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:46 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-025fef2f-3123-405f-93b8-ddc117b7385a tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b46af525dd45678b69207e93683ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0648ea953174a8cae6085ac24d92bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:53:46 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-025fef2f-3123-405f-93b8-ddc117b7385a tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b" status: 200 len: 1534 microversion: 2.1 time: 0.171471 Apr 13 22:53:46 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 36/103] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:53:46 2023] GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b => generated 1534 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:53:48 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=7 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:48 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=7 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:48 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-480f0b0a-0323-4143-92c5-6df1cc0131c7 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:53:48 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-480f0b0a-0323-4143-92c5-6df1cc0131c7 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:53:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-480f0b0a-0323-4143-92c5-6df1cc0131c7 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-480f0b0a-0323-4143-92c5-6df1cc0131c7 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-480f0b0a-0323-4143-92c5-6df1cc0131c7 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-480f0b0a-0323-4143-92c5-6df1cc0131c7 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-480f0b0a-0323-4143-92c5-6df1cc0131c7 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-480f0b0a-0323-4143-92c5-6df1cc0131c7 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:49 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-480f0b0a-0323-4143-92c5-6df1cc0131c7 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:53:49 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-480f0b0a-0323-4143-92c5-6df1cc0131c7 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff417f05-3cfa-4274-a0d9-9145ce1e5f83" status: 200 len: 1505 microversion: 2.1 time: 0.307054 Apr 13 22:53:49 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 35/104] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:53:48 2023] GET /compute/v2.1/servers/ff417f05-3cfa-4274-a0d9-9145ce1e5f83 => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:53:51 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-6a8585f5-e0db-4a08-8c52-e63268c98ba3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:53:51 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-6a8585f5-e0db-4a08-8c52-e63268c98ba3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:53:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6a8585f5-e0db-4a08-8c52-e63268c98ba3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6a8585f5-e0db-4a08-8c52-e63268c98ba3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6a8585f5-e0db-4a08-8c52-e63268c98ba3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6a8585f5-e0db-4a08-8c52-e63268c98ba3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:53:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6a8585f5-e0db-4a08-8c52-e63268c98ba3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:53:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6a8585f5-e0db-4a08-8c52-e63268c98ba3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:53:51 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=19 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:53:51 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-6a8585f5-e0db-4a08-8c52-e63268c98ba3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98594f3f6ccf4ffdbfd91bcf192d936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ccac99656842aca44f9f1eb7aa167a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:53:51 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-6a8585f5-e0db-4a08-8c52-e63268c98ba3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63" status: 200 len: 1545 microversion: 2.1 time: 0.176295 Apr 13 22:53:51 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 34/105] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:53:51 2023] GET /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63 => generated 1545 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 22:54:03 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-8cc4126d-fa00-4859-89e9-ed9d4b9f9d76 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:54:03 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-8cc4126d-fa00-4859-89e9-ed9d4b9f9d76 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:54:03 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:54:03 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:54:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8cc4126d-fa00-4859-89e9-ed9d4b9f9d76 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8cc4126d-fa00-4859-89e9-ed9d4b9f9d76 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8cc4126d-fa00-4859-89e9-ed9d4b9f9d76 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8cc4126d-fa00-4859-89e9-ed9d4b9f9d76 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8cc4126d-fa00-4859-89e9-ed9d4b9f9d76 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8cc4126d-fa00-4859-89e9-ed9d4b9f9d76 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:03 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-8cc4126d-fa00-4859-89e9-ed9d4b9f9d76 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b08dea04784bc3b07195f951a84bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33cf3bf67714b0ba9c7f703a1c9e5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:54:03 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-8cc4126d-fa00-4859-89e9-ed9d4b9f9d76 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063" status: 200 len: 1543 microversion: 2.1 time: 0.206081 Apr 13 22:54:03 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 37/106] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:54:03 2023] GET /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063 => generated 1543 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:54:06 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:54:06 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:54:06 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-2b7b498e-ae44-4f28-9a14-77a19eb18c4b tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:54:06 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-2b7b498e-ae44-4f28-9a14-77a19eb18c4b tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:54:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2b7b498e-ae44-4f28-9a14-77a19eb18c4b tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2b7b498e-ae44-4f28-9a14-77a19eb18c4b tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2b7b498e-ae44-4f28-9a14-77a19eb18c4b tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2b7b498e-ae44-4f28-9a14-77a19eb18c4b tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2b7b498e-ae44-4f28-9a14-77a19eb18c4b tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2b7b498e-ae44-4f28-9a14-77a19eb18c4b tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:06 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-2b7b498e-ae44-4f28-9a14-77a19eb18c4b tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd624ba67e327453881558410a112910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc753ebae6474a4b8a914b240795df82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:54:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-2b7b498e-ae44-4f28-9a14-77a19eb18c4b tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab" status: 200 len: 1549 microversion: 2.1 time: 0.179945 Apr 13 22:54:06 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 36/107] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:54:06 2023] GET /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab => generated 1549 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:54:10 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1409547542", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "364674b2-460b-4c60-a0c0-e39820135f5b", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "aadb940e-808f-4d62-87fe-765d072b7c2f"}]}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:54:10 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:54:10 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=5 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:54:10 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] validate_networks() for [('aadb940e-808f-4d62-87fe-765d072b7c2f', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:54:10 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:54:10 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:54:10 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:54:10 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:54:10 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:54:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:10 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting quotas for project d872848d5dc1471996e2f33bbbdebbd9. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:54:10 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting quotas for user b289294050af4c41aeef8401832487a1 and project d872848d5dc1471996e2f33bbbdebbd9. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:54:10 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:54:10 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='364674b2-460b-4c60-a0c0-e39820135f5b',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:54:10 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.687948 Apr 13 22:54:10 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 35/108] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:54:10 2023] POST /compute/v2.1/servers => generated 378 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:54:10 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-7554a979-c12f-4962-9f41-20ec1c85ede5 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:54:10 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-7554a979-c12f-4962-9f41-20ec1c85ede5 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:54:11 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-7554a979-c12f-4962-9f41-20ec1c85ede5 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:54:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-7554a979-c12f-4962-9f41-20ec1c85ede5 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d" status: 200 len: 1052 microversion: 2.1 time: 0.075471 Apr 13 22:54:11 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 38/109] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:54:10 2023] GET /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d => generated 1052 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:54:14 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-a3c5d0e0-0fbf-4733-a21d-4e7ad3c81207 req-17b13f14-8b68-491d-870d-4793aab0cac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a0a6479-bc85-4617-8225-d8169dfb2c8d", "tag": "919802cc-1446-473e-8f73-b2f8a10750ee"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:54:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a3c5d0e0-0fbf-4733-a21d-4e7ad3c81207 req-17b13f14-8b68-491d-870d-4793aab0cac0 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a3c5d0e0-0fbf-4733-a21d-4e7ad3c81207 req-17b13f14-8b68-491d-870d-4793aab0cac0 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a3c5d0e0-0fbf-4733-a21d-4e7ad3c81207 req-17b13f14-8b68-491d-870d-4793aab0cac0 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:14 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-a3c5d0e0-0fbf-4733-a21d-4e7ad3c81207 req-17b13f14-8b68-491d-870d-4793aab0cac0 service nova] Creating event network-changed:919802cc-1446-473e-8f73-b2f8a10750ee for instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d on user Apr 13 22:54:14 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-a3c5d0e0-0fbf-4733-a21d-4e7ad3c81207 req-17b13f14-8b68-491d-870d-4793aab0cac0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063096 Apr 13 22:54:14 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 37/110] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:54:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:54:14 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-a0d34b18-f396-4049-bd70-16ac1df33b59 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:54:14 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-a0d34b18-f396-4049-bd70-16ac1df33b59 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:54:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a0d34b18-f396-4049-bd70-16ac1df33b59 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a0d34b18-f396-4049-bd70-16ac1df33b59 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a0d34b18-f396-4049-bd70-16ac1df33b59 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a0d34b18-f396-4049-bd70-16ac1df33b59 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a0d34b18-f396-4049-bd70-16ac1df33b59 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a0d34b18-f396-4049-bd70-16ac1df33b59 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:14 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-a0d34b18-f396-4049-bd70-16ac1df33b59 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20751f66f6564d04807dc09a675aef70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f871045289a43d18b339d3dac4d0666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:54:14 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-a0d34b18-f396-4049-bd70-16ac1df33b59 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128" status: 200 len: 1525 microversion: 2.1 time: 0.186284 Apr 13 22:54:14 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 36/111] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:54:14 2023] GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128 => generated 1525 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:54:28 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-0670f3ae-f0c9-415d-a7db-7d237b3a7fa5 req-c40c81d4-54ee-48a4-a473-6549ef12784e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a0a6479-bc85-4617-8225-d8169dfb2c8d", "name": "network-vif-plugged", "status": "completed", "tag": "919802cc-1446-473e-8f73-b2f8a10750ee"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:54:28 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:54:28 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:54:28 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:54:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0670f3ae-f0c9-415d-a7db-7d237b3a7fa5 req-c40c81d4-54ee-48a4-a473-6549ef12784e service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0670f3ae-f0c9-415d-a7db-7d237b3a7fa5 req-c40c81d4-54ee-48a4-a473-6549ef12784e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0670f3ae-f0c9-415d-a7db-7d237b3a7fa5 req-c40c81d4-54ee-48a4-a473-6549ef12784e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:28 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-0670f3ae-f0c9-415d-a7db-7d237b3a7fa5 req-c40c81d4-54ee-48a4-a473-6549ef12784e service nova] Creating event network-vif-plugged:919802cc-1446-473e-8f73-b2f8a10750ee for instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d on user Apr 13 22:54:28 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-0670f3ae-f0c9-415d-a7db-7d237b3a7fa5 req-c40c81d4-54ee-48a4-a473-6549ef12784e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039259 Apr 13 22:54:28 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 39/112] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:54:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:54:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-46c7dfe0-624d-4641-893d-f22ce920f9b6 req-f1664f6d-ce83-4e29-bd57-5b678eeb85fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a0a6479-bc85-4617-8225-d8169dfb2c8d", "name": "network-vif-plugged", "status": "completed", "tag": "919802cc-1446-473e-8f73-b2f8a10750ee"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:54:30 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:54:30 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=8 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:54:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-46c7dfe0-624d-4641-893d-f22ce920f9b6 req-f1664f6d-ce83-4e29-bd57-5b678eeb85fa service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-46c7dfe0-624d-4641-893d-f22ce920f9b6 req-f1664f6d-ce83-4e29-bd57-5b678eeb85fa service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-46c7dfe0-624d-4641-893d-f22ce920f9b6 req-f1664f6d-ce83-4e29-bd57-5b678eeb85fa service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:30 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-46c7dfe0-624d-4641-893d-f22ce920f9b6 req-f1664f6d-ce83-4e29-bd57-5b678eeb85fa service nova] Creating event network-vif-plugged:919802cc-1446-473e-8f73-b2f8a10750ee for instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d on user Apr 13 22:54:30 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-46c7dfe0-624d-4641-893d-f22ce920f9b6 req-f1664f6d-ce83-4e29-bd57-5b678eeb85fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043327 Apr 13 22:54:30 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 38/113] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:54:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:54:33 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:54:33 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:54:33 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:54:33 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=8 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:54:33 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-61af3ec4-3faf-41b3-90a3-633bb416a6d0 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:54:33 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-61af3ec4-3faf-41b3-90a3-633bb416a6d0 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:54:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-61af3ec4-3faf-41b3-90a3-633bb416a6d0 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-61af3ec4-3faf-41b3-90a3-633bb416a6d0 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-61af3ec4-3faf-41b3-90a3-633bb416a6d0 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-61af3ec4-3faf-41b3-90a3-633bb416a6d0 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-61af3ec4-3faf-41b3-90a3-633bb416a6d0 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-61af3ec4-3faf-41b3-90a3-633bb416a6d0 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:34 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-61af3ec4-3faf-41b3-90a3-633bb416a6d0 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.188316 Apr 13 22:54:34 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 37/114] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 22:54:33 2023] GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499/os-interface => generated 282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:54:35 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-544f17b3-8ed4-451b-857f-73cc1308d8c6 req-88958e91-74ae-4306-94e5-a02b0825402b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f241623-e618-42eb-87d1-0606e37ec499", "tag": "87e984d6-f653-4e7e-a230-53cd27a17d97"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:54:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-544f17b3-8ed4-451b-857f-73cc1308d8c6 req-88958e91-74ae-4306-94e5-a02b0825402b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-544f17b3-8ed4-451b-857f-73cc1308d8c6 req-88958e91-74ae-4306-94e5-a02b0825402b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-544f17b3-8ed4-451b-857f-73cc1308d8c6 req-88958e91-74ae-4306-94e5-a02b0825402b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-544f17b3-8ed4-451b-857f-73cc1308d8c6 req-88958e91-74ae-4306-94e5-a02b0825402b service nova] Creating event network-changed:87e984d6-f653-4e7e-a230-53cd27a17d97 for instance 3f241623-e618-42eb-87d1-0606e37ec499 on user Apr 13 22:54:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-544f17b3-8ed4-451b-857f-73cc1308d8c6 req-88958e91-74ae-4306-94e5-a02b0825402b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042638 Apr 13 22:54:35 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 40/115] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:54:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:54:35 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1279281190"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:54:35 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:54:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:37 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499/action" status: 202 len: 0 microversion: 2.1 time: 1.623049 Apr 13 22:54:37 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 39/116] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 22:54:35 2023] POST /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499/action => generated 0 bytes in 1625 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 13 22:54:37 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-bc2b8386-6096-4149-86c7-3247ea24f7bc tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Calling method '.version_select at 0x7f3d1e208f70>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:54:37 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-bc2b8386-6096-4149-86c7-3247ea24f7bc tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "GET /compute/v2.1/images/c843b543-e4c9-4201-984c-e4b14f1c0d99" status: 200 len: 1609 microversion: 2.1 time: 0.049187 Apr 13 22:54:37 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 38/117] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 22:54:37 2023] GET /compute/v2.1/images/c843b543-e4c9-4201-984c-e4b14f1c0d99 => generated 1609 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:54:45 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:54:45 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:54:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:45 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] 10.0.0.210 "POST /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.437508 Apr 13 22:54:45 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 41/118] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:54:45 2023] POST /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154/os-volume_attachments => generated 194 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:54:47 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:54:47 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-a2f3be25-0a38-4507-9d26-18a5971c0801 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:54:47 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-a2f3be25-0a38-4507-9d26-18a5971c0801 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:54:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a2f3be25-0a38-4507-9d26-18a5971c0801 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a2f3be25-0a38-4507-9d26-18a5971c0801 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a2f3be25-0a38-4507-9d26-18a5971c0801 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a2f3be25-0a38-4507-9d26-18a5971c0801 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a2f3be25-0a38-4507-9d26-18a5971c0801 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a2f3be25-0a38-4507-9d26-18a5971c0801 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:47 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-a2f3be25-0a38-4507-9d26-18a5971c0801 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.133451 Apr 13 22:54:47 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 40/119] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 22:54:47 2023] GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b/os-interface => generated 282 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:54:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-854a5964-35bb-482a-8318-0708d27a3f70 req-220f1b19-1dcf-49c1-80bb-2062f27da7e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92e1fa88-8896-4198-af4d-56d44baf3b9b", "tag": "94c47f47-2ee7-46d0-858d-a5ff3270a80b"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:54:48 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:54:48 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:54:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-854a5964-35bb-482a-8318-0708d27a3f70 req-220f1b19-1dcf-49c1-80bb-2062f27da7e3 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-854a5964-35bb-482a-8318-0708d27a3f70 req-220f1b19-1dcf-49c1-80bb-2062f27da7e3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-854a5964-35bb-482a-8318-0708d27a3f70 req-220f1b19-1dcf-49c1-80bb-2062f27da7e3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-854a5964-35bb-482a-8318-0708d27a3f70 req-220f1b19-1dcf-49c1-80bb-2062f27da7e3 service nova] Creating event network-changed:94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b on user Apr 13 22:54:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-854a5964-35bb-482a-8318-0708d27a3f70 req-220f1b19-1dcf-49c1-80bb-2062f27da7e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043609 Apr 13 22:54:48 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 39/120] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:54:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:54:48 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-e8dc0311-3ad7-4a5b-a2a4-e8f317642d14 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:54:48 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-e8dc0311-3ad7-4a5b-a2a4-e8f317642d14 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:54:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e8dc0311-3ad7-4a5b-a2a4-e8f317642d14 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e8dc0311-3ad7-4a5b-a2a4-e8f317642d14 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e8dc0311-3ad7-4a5b-a2a4-e8f317642d14 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e8dc0311-3ad7-4a5b-a2a4-e8f317642d14 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e8dc0311-3ad7-4a5b-a2a4-e8f317642d14 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e8dc0311-3ad7-4a5b-a2a4-e8f317642d14 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:48 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-e8dc0311-3ad7-4a5b-a2a4-e8f317642d14 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b/ips" status: 200 len: 103 microversion: 2.1 time: 0.035102 Apr 13 22:54:48 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 42/121] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 22:54:48 2023] GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b/ips => generated 103 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:54:49 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:54:49 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:54:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:49 user devstack@n-api.service[61613]: DEBUG nova.objects.instance [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'flavor' on Instance uuid ff417f05-3cfa-4274-a0d9-9145ce1e5f83 {{(pid=61613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:54:49 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/action" status: 200 len: 32 microversion: 2.1 time: 0.147401 Apr 13 22:54:49 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 41/122] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 22:54:49 2023] POST /compute/v2.1/servers/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/action => generated 32 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 22:54:49 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-b31d3b6a-660e-46e4-95a7-4a2a70d2ef07 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:54:49 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-b31d3b6a-660e-46e4-95a7-4a2a70d2ef07 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:54:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b31d3b6a-660e-46e4-95a7-4a2a70d2ef07 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b31d3b6a-660e-46e4-95a7-4a2a70d2ef07 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b31d3b6a-660e-46e4-95a7-4a2a70d2ef07 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b31d3b6a-660e-46e4-95a7-4a2a70d2ef07 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b31d3b6a-660e-46e4-95a7-4a2a70d2ef07 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b31d3b6a-660e-46e4-95a7-4a2a70d2ef07 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:49 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-b31d3b6a-660e-46e4-95a7-4a2a70d2ef07 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:54:49 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-b31d3b6a-660e-46e4-95a7-4a2a70d2ef07 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff417f05-3cfa-4274-a0d9-9145ce1e5f83" status: 200 len: 1511 microversion: 2.1 time: 0.177156 Apr 13 22:54:49 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 40/123] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:54:49 2023] GET /compute/v2.1/servers/ff417f05-3cfa-4274-a0d9-9145ce1e5f83 => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:54:50 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a58090c7-ce32-4a3f-a2f0-f327259775e7"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:54:50 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:54:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:50 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-18f3606e-b082-4f49-9fff-9d0e027dc176 req-300bc18f-1edb-41d5-987d-e0242a3f2bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff417f05-3cfa-4274-a0d9-9145ce1e5f83", "name": "network-vif-unplugged", "status": "completed", "tag": "ac600f3d-8b2c-4200-81dd-3d35843d3f28"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:54:50 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-18f3606e-b082-4f49-9fff-9d0e027dc176 req-300bc18f-1edb-41d5-987d-e0242a3f2bc2 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:50 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-18f3606e-b082-4f49-9fff-9d0e027dc176 req-300bc18f-1edb-41d5-987d-e0242a3f2bc2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:50 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-18f3606e-b082-4f49-9fff-9d0e027dc176 req-300bc18f-1edb-41d5-987d-e0242a3f2bc2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:50 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-18f3606e-b082-4f49-9fff-9d0e027dc176 req-300bc18f-1edb-41d5-987d-e0242a3f2bc2 service nova] Creating event network-vif-unplugged:ac600f3d-8b2c-4200-81dd-3d35843d3f28 for instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 on user Apr 13 22:54:50 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-18f3606e-b082-4f49-9fff-9d0e027dc176 req-300bc18f-1edb-41d5-987d-e0242a3f2bc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032594 Apr 13 22:54:50 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 42/124] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:54:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:54:51 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "POST /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.615813 Apr 13 22:54:51 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 43/125] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:54:50 2023] POST /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b/os-volume_attachments => generated 194 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:54:51 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-e295e7bc-5c82-4930-9635-b8a35151615a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:54:51 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-e295e7bc-5c82-4930-9635-b8a35151615a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:54:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e295e7bc-5c82-4930-9635-b8a35151615a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e295e7bc-5c82-4930-9635-b8a35151615a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e295e7bc-5c82-4930-9635-b8a35151615a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e295e7bc-5c82-4930-9635-b8a35151615a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e295e7bc-5c82-4930-9635-b8a35151615a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e295e7bc-5c82-4930-9635-b8a35151615a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:51 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-e295e7bc-5c82-4930-9635-b8a35151615a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.121516 Apr 13 22:54:51 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 41/126] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 22:54:51 2023] GET /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/os-interface => generated 283 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 22:54:52 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-4bc41c41-0a10-4405-88b4-3809cc9d849e req-e20180c3-240f-436e-a784-22cfe5c3f3be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e10dfa7-4997-44b0-b26d-421c7a2d8b63", "tag": "822bdb49-5f9a-4949-8543-929b1764e810"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:54:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4bc41c41-0a10-4405-88b4-3809cc9d849e req-e20180c3-240f-436e-a784-22cfe5c3f3be service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4bc41c41-0a10-4405-88b4-3809cc9d849e req-e20180c3-240f-436e-a784-22cfe5c3f3be service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4bc41c41-0a10-4405-88b4-3809cc9d849e req-e20180c3-240f-436e-a784-22cfe5c3f3be service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:52 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-4bc41c41-0a10-4405-88b4-3809cc9d849e req-e20180c3-240f-436e-a784-22cfe5c3f3be service nova] Creating event network-changed:822bdb49-5f9a-4949-8543-929b1764e810 for instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 on user Apr 13 22:54:52 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-4bc41c41-0a10-4405-88b4-3809cc9d849e req-e20180c3-240f-436e-a784-22cfe5c3f3be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029452 Apr 13 22:54:52 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 43/127] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:54:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:54:52 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-70d101a5-e735-4c27-9de4-772afd12729a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:54:52 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-70d101a5-e735-4c27-9de4-772afd12729a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:54:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-70d101a5-e735-4c27-9de4-772afd12729a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-70d101a5-e735-4c27-9de4-772afd12729a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-70d101a5-e735-4c27-9de4-772afd12729a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-70d101a5-e735-4c27-9de4-772afd12729a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-70d101a5-e735-4c27-9de4-772afd12729a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-70d101a5-e735-4c27-9de4-772afd12729a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:52 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-70d101a5-e735-4c27-9de4-772afd12729a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/ips" status: 200 len: 109 microversion: 2.1 time: 0.036626 Apr 13 22:54:52 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 44/128] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 22:54:52 2023] GET /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/ips => generated 109 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:54:52 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-f3f4fded-8197-4d1e-9bb3-97a172a08462 req-d7da916f-9942-4a72-9402-a0da6de90251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff417f05-3cfa-4274-a0d9-9145ce1e5f83", "name": "network-vif-plugged", "status": "completed", "tag": "ac600f3d-8b2c-4200-81dd-3d35843d3f28"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:54:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f3f4fded-8197-4d1e-9bb3-97a172a08462 req-d7da916f-9942-4a72-9402-a0da6de90251 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f3f4fded-8197-4d1e-9bb3-97a172a08462 req-d7da916f-9942-4a72-9402-a0da6de90251 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f3f4fded-8197-4d1e-9bb3-97a172a08462 req-d7da916f-9942-4a72-9402-a0da6de90251 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:52 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f3f4fded-8197-4d1e-9bb3-97a172a08462 req-d7da916f-9942-4a72-9402-a0da6de90251 service nova] Creating event network-vif-plugged:ac600f3d-8b2c-4200-81dd-3d35843d3f28 for instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 on user Apr 13 22:54:52 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-f3f4fded-8197-4d1e-9bb3-97a172a08462 req-d7da916f-9942-4a72-9402-a0da6de90251 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027028 Apr 13 22:54:52 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 42/129] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:54:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:54:54 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:54:54 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:54:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:54 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:54:54 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154" status: 204 len: 0 microversion: 2.1 time: 0.131197 Apr 13 22:54:54 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 44/130] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:54:54 2023] DELETE /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:54:54 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-7ecd1602-be20-4f57-8009-a0ded16e8d9b tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:54:54 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-7ecd1602-be20-4f57-8009-a0ded16e8d9b tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:54:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7ecd1602-be20-4f57-8009-a0ded16e8d9b tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7ecd1602-be20-4f57-8009-a0ded16e8d9b tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7ecd1602-be20-4f57-8009-a0ded16e8d9b tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7ecd1602-be20-4f57-8009-a0ded16e8d9b tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7ecd1602-be20-4f57-8009-a0ded16e8d9b tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7ecd1602-be20-4f57-8009-a0ded16e8d9b tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:54 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-6731d89c-6d25-4ea3-87e4-d613c348fe14 req-1b6f41cb-e8b2-44be-ae2c-f79b523ed858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff417f05-3cfa-4274-a0d9-9145ce1e5f83", "name": "network-vif-plugged", "status": "completed", "tag": "ac600f3d-8b2c-4200-81dd-3d35843d3f28"}, {"server_uuid": "ff417f05-3cfa-4274-a0d9-9145ce1e5f83", "name": "network-vif-plugged", "status": "completed", "tag": "ac600f3d-8b2c-4200-81dd-3d35843d3f28"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:54:54 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6731d89c-6d25-4ea3-87e4-d613c348fe14 req-1b6f41cb-e8b2-44be-ae2c-f79b523ed858 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:54 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6731d89c-6d25-4ea3-87e4-d613c348fe14 req-1b6f41cb-e8b2-44be-ae2c-f79b523ed858 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:54 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6731d89c-6d25-4ea3-87e4-d613c348fe14 req-1b6f41cb-e8b2-44be-ae2c-f79b523ed858 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:54 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-6731d89c-6d25-4ea3-87e4-d613c348fe14 req-1b6f41cb-e8b2-44be-ae2c-f79b523ed858 service nova] Creating event network-vif-plugged:ac600f3d-8b2c-4200-81dd-3d35843d3f28 for instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 on user Apr 13 22:54:54 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-6731d89c-6d25-4ea3-87e4-d613c348fe14 req-1b6f41cb-e8b2-44be-ae2c-f79b523ed858 service nova] Creating event network-vif-plugged:ac600f3d-8b2c-4200-81dd-3d35843d3f28 for instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 on user Apr 13 22:54:54 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-6731d89c-6d25-4ea3-87e4-d613c348fe14 req-1b6f41cb-e8b2-44be-ae2c-f79b523ed858 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034697 Apr 13 22:54:54 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 43/131] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:54:54 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:54:54 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-7ecd1602-be20-4f57-8009-a0ded16e8d9b tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd77e681f9467db86ff56ff8f516b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c86d23c9fa4c60b53700b0798a215f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:54:54 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-7ecd1602-be20-4f57-8009-a0ded16e8d9b tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154" status: 200 len: 1541 microversion: 2.1 time: 0.333474 Apr 13 22:54:54 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 45/132] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:54:54 2023] GET /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154 => generated 1541 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:54:54 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-2bcd4218-e105-45f0-be4e-ae992cb34ca9 req-78c7f049-6c4e-415f-95f3-a898042c3307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636a69ed-f9b3-4b91-b371-7f7bf3e85154", "name": "network-vif-unplugged", "status": "completed", "tag": "7c255119-87ff-437e-baec-874090c7c7e4"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:54:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2bcd4218-e105-45f0-be4e-ae992cb34ca9 req-78c7f049-6c4e-415f-95f3-a898042c3307 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2bcd4218-e105-45f0-be4e-ae992cb34ca9 req-78c7f049-6c4e-415f-95f3-a898042c3307 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2bcd4218-e105-45f0-be4e-ae992cb34ca9 req-78c7f049-6c4e-415f-95f3-a898042c3307 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:55 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-2bcd4218-e105-45f0-be4e-ae992cb34ca9 req-78c7f049-6c4e-415f-95f3-a898042c3307 service nova] Creating event network-vif-unplugged:7c255119-87ff-437e-baec-874090c7c7e4 for instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 on user Apr 13 22:54:55 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-2bcd4218-e105-45f0-be4e-ae992cb34ca9 req-78c7f049-6c4e-415f-95f3-a898042c3307 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032476 Apr 13 22:54:55 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 45/133] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:54:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:54:55 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "098aedca-2822-4384-bff5-58cccb0f96a0"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:54:55 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:54:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:55 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.500481 Apr 13 22:54:55 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 44/134] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:54:55 2023] POST /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/os-volume_attachments => generated 194 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:54:57 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-092530b9-39a0-448f-a697-fd2f38cd5963 req-2cf8bf9b-5f11-41a5-80f1-e4885f6ee153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636a69ed-f9b3-4b91-b371-7f7bf3e85154", "name": "network-vif-plugged", "status": "completed", "tag": "7c255119-87ff-437e-baec-874090c7c7e4"}, {"server_uuid": "636a69ed-f9b3-4b91-b371-7f7bf3e85154", "name": "network-vif-deleted", "tag": "7c255119-87ff-437e-baec-874090c7c7e4"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:54:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-092530b9-39a0-448f-a697-fd2f38cd5963 req-2cf8bf9b-5f11-41a5-80f1-e4885f6ee153 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-092530b9-39a0-448f-a697-fd2f38cd5963 req-2cf8bf9b-5f11-41a5-80f1-e4885f6ee153 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-092530b9-39a0-448f-a697-fd2f38cd5963 req-2cf8bf9b-5f11-41a5-80f1-e4885f6ee153 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:57 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-092530b9-39a0-448f-a697-fd2f38cd5963 req-2cf8bf9b-5f11-41a5-80f1-e4885f6ee153 service nova] Creating event network-vif-plugged:7c255119-87ff-437e-baec-874090c7c7e4 for instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 on user Apr 13 22:54:57 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-092530b9-39a0-448f-a697-fd2f38cd5963 req-2cf8bf9b-5f11-41a5-80f1-e4885f6ee153 service nova] Creating event network-vif-deleted:7c255119-87ff-437e-baec-874090c7c7e4 for instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 on user Apr 13 22:54:57 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-092530b9-39a0-448f-a697-fd2f38cd5963 req-2cf8bf9b-5f11-41a5-80f1-e4885f6ee153 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031140 Apr 13 22:54:57 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 46/135] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:54:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:54:59 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-0328e7b8-5541-438c-9392-b1d4cdb13fc9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:54:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0328e7b8-5541-438c-9392-b1d4cdb13fc9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0328e7b8-5541-438c-9392-b1d4cdb13fc9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0328e7b8-5541-438c-9392-b1d4cdb13fc9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:59 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-0328e7b8-5541-438c-9392-b1d4cdb13fc9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Going to try to stop instance {{(pid=61613) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 13 22:54:59 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-0328e7b8-5541-438c-9392-b1d4cdb13fc9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "POST /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b/action" status: 202 len: 0 microversion: 2.1 time: 0.209647 Apr 13 22:54:59 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 46/136] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 22:54:59 2023] POST /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:54:59 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-0eadd3e2-17ae-4502-a2c0-e52c58b7a1ca tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:54:59 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-0eadd3e2-17ae-4502-a2c0-e52c58b7a1ca tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:54:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0eadd3e2-17ae-4502-a2c0-e52c58b7a1ca tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0eadd3e2-17ae-4502-a2c0-e52c58b7a1ca tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0eadd3e2-17ae-4502-a2c0-e52c58b7a1ca tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0eadd3e2-17ae-4502-a2c0-e52c58b7a1ca tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0eadd3e2-17ae-4502-a2c0-e52c58b7a1ca tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0eadd3e2-17ae-4502-a2c0-e52c58b7a1ca tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:59 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-0eadd3e2-17ae-4502-a2c0-e52c58b7a1ca tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b46af525dd45678b69207e93683ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0648ea953174a8cae6085ac24d92bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:54:59 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-0eadd3e2-17ae-4502-a2c0-e52c58b7a1ca tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b" status: 200 len: 1708 microversion: 2.1 time: 0.594990 Apr 13 22:54:59 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 45/137] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:54:59 2023] GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b => generated 1708 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 22:54:59 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-d2902be3-d890-4315-bece-eab20c10e181 req-736edd2f-25d2-4df0-a67b-edb7ac3fbf28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e1fa88-8896-4198-af4d-56d44baf3b9b", "name": "network-vif-unplugged", "status": "completed", "tag": "94c47f47-2ee7-46d0-858d-a5ff3270a80b"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:54:59 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=17 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:54:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d2902be3-d890-4315-bece-eab20c10e181 req-736edd2f-25d2-4df0-a67b-edb7ac3fbf28 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:54:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d2902be3-d890-4315-bece-eab20c10e181 req-736edd2f-25d2-4df0-a67b-edb7ac3fbf28 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:54:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d2902be3-d890-4315-bece-eab20c10e181 req-736edd2f-25d2-4df0-a67b-edb7ac3fbf28 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:54:59 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:54:59 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-d2902be3-d890-4315-bece-eab20c10e181 req-736edd2f-25d2-4df0-a67b-edb7ac3fbf28 service nova] Creating event network-vif-unplugged:94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b on user Apr 13 22:54:59 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-d2902be3-d890-4315-bece-eab20c10e181 req-736edd2f-25d2-4df0-a67b-edb7ac3fbf28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042415 Apr 13 22:54:59 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 47/138] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:54:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:55:01 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5eab57f7-b032-4250-8d9f-bec2da2ec8d0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:01 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-5eab57f7-b032-4250-8d9f-bec2da2ec8d0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5eab57f7-b032-4250-8d9f-bec2da2ec8d0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5eab57f7-b032-4250-8d9f-bec2da2ec8d0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5eab57f7-b032-4250-8d9f-bec2da2ec8d0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5eab57f7-b032-4250-8d9f-bec2da2ec8d0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5eab57f7-b032-4250-8d9f-bec2da2ec8d0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5eab57f7-b032-4250-8d9f-bec2da2ec8d0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:01 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:55:01 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-5eab57f7-b032-4250-8d9f-bec2da2ec8d0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:55:01 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-5eab57f7-b032-4250-8d9f-bec2da2ec8d0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d" status: 200 len: 1380 microversion: 2.1 time: 0.198318 Apr 13 22:55:01 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 47/139] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:55:01 2023] GET /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d => generated 1380 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:55:02 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-4af8d587-748b-46a2-a4ae-911373b73847 req-ba908e10-1299-4dee-a985-d8b223b68f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e1fa88-8896-4198-af4d-56d44baf3b9b", "name": "network-vif-plugged", "status": "completed", "tag": "94c47f47-2ee7-46d0-858d-a5ff3270a80b"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:55:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-4af8d587-748b-46a2-a4ae-911373b73847 req-ba908e10-1299-4dee-a985-d8b223b68f35 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-4af8d587-748b-46a2-a4ae-911373b73847 req-ba908e10-1299-4dee-a985-d8b223b68f35 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-4af8d587-748b-46a2-a4ae-911373b73847 req-ba908e10-1299-4dee-a985-d8b223b68f35 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-4af8d587-748b-46a2-a4ae-911373b73847 req-ba908e10-1299-4dee-a985-d8b223b68f35 service nova] Creating event network-vif-plugged:94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b on user Apr 13 22:55:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-4af8d587-748b-46a2-a4ae-911373b73847 req-ba908e10-1299-4dee-a985-d8b223b68f35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058122 Apr 13 22:55:02 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 46/140] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:55:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:55:03 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-636050cf-bad3-4f83-aa86-003d554c7090 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Action: 'create', calling method: .version_select at 0x7f3d1e2bf6d0>, body: {"keypair": {"name": "tempest-keypair-1770675987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/fIOmV2oYNa5X2ielk8jHAzzKZDAmddNM9O0Vg4iA3cFAMMTj3Mu0r6iY22xgj5uoQiV5bWcCQVTWzxrknDJXU2Fxq/BhxckivvclzEiTgSKiPMw1SKzeL/rXorxQvTA=="}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:55:03 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-636050cf-bad3-4f83-aa86-003d554c7090 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting quotas for project 85ccac99656842aca44f9f1eb7aa167a. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:55:03 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-636050cf-bad3-4f83-aa86-003d554c7090 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting quotas for user 98594f3f6ccf4ffdbfd91bcf192d936e and project 85ccac99656842aca44f9f1eb7aa167a. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:55:03 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-636050cf-bad3-4f83-aa86-003d554c7090 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047936 Apr 13 22:55:03 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 48/141] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 22:55:03 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:55:04 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8a10805e-2b05-4891-ba47-3ff0d4787a26 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:04 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-8a10805e-2b05-4891-ba47-3ff0d4787a26 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8a10805e-2b05-4891-ba47-3ff0d4787a26 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8a10805e-2b05-4891-ba47-3ff0d4787a26 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8a10805e-2b05-4891-ba47-3ff0d4787a26 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8a10805e-2b05-4891-ba47-3ff0d4787a26 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8a10805e-2b05-4891-ba47-3ff0d4787a26 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8a10805e-2b05-4891-ba47-3ff0d4787a26 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:04 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-8a10805e-2b05-4891-ba47-3ff0d4787a26 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.109361 Apr 13 22:55:04 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 48/142] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 22:55:04 2023] GET /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063/os-interface => generated 282 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:55:04 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-559e98a0-2ac3-4526-b426-91b120114900 req-c7aeab4b-4548-479d-9c87-218409bdc186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2355fe9d-511a-4e7c-ac2a-5bddc034e063", "tag": "3958622e-6a70-4931-b630-26e0a53c5755"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:55:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-559e98a0-2ac3-4526-b426-91b120114900 req-c7aeab4b-4548-479d-9c87-218409bdc186 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-559e98a0-2ac3-4526-b426-91b120114900 req-c7aeab4b-4548-479d-9c87-218409bdc186 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-559e98a0-2ac3-4526-b426-91b120114900 req-c7aeab4b-4548-479d-9c87-218409bdc186 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:04 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-559e98a0-2ac3-4526-b426-91b120114900 req-c7aeab4b-4548-479d-9c87-218409bdc186 service nova] Creating event network-changed:3958622e-6a70-4931-b630-26e0a53c5755 for instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 on user Apr 13 22:55:04 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-559e98a0-2ac3-4526-b426-91b120114900 req-c7aeab4b-4548-479d-9c87-218409bdc186 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038112 Apr 13 22:55:04 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 47/143] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:55:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:55:06 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-327963572", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf"}], "security_groups": [{"name": "tempest-securitygroup--286463980"}], "key_name": "tempest-keypair-1770675987", "user_data": "}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:55:06 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-973340e3-1381-4d9d-9035-1020e90daac4 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:06 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-973340e3-1381-4d9d-9035-1020e90daac4 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-973340e3-1381-4d9d-9035-1020e90daac4 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-973340e3-1381-4d9d-9035-1020e90daac4 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-973340e3-1381-4d9d-9035-1020e90daac4 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-973340e3-1381-4d9d-9035-1020e90daac4 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-973340e3-1381-4d9d-9035-1020e90daac4 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-973340e3-1381-4d9d-9035-1020e90daac4 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:06 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] validate_networks() for [('d59145a7-f00c-4cd3-ab12-f4b6ae2608cf', None, None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:55:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-973340e3-1381-4d9d-9035-1020e90daac4 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.107229 Apr 13 22:55:06 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 49/144] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 22:55:06 2023] GET /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab/os-interface => generated 282 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:55:06 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:55:06 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:55:06 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:55:06 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:55:06 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:55:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:06 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting quotas for project 85ccac99656842aca44f9f1eb7aa167a. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:55:06 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting quotas for user 98594f3f6ccf4ffdbfd91bcf192d936e and project 85ccac99656842aca44f9f1eb7aa167a. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:55:06 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:55:06 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:55:06 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.667914 Apr 13 22:55:06 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 49/145] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:55:06 2023] POST /compute/v2.1/servers => generated 399 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:55:06 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-c0b87ced-738d-4b9b-9a86-62017f630f99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:06 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-c0b87ced-738d-4b9b-9a86-62017f630f99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:07 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-c0b87ced-738d-4b9b-9a86-62017f630f99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98594f3f6ccf4ffdbfd91bcf192d936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ccac99656842aca44f9f1eb7aa167a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:55:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-c0b87ced-738d-4b9b-9a86-62017f630f99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f" status: 200 len: 1235 microversion: 2.1 time: 0.070810 Apr 13 22:55:07 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 48/146] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:55:06 2023] GET /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f => generated 1235 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:55:07 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c927ee17-9542-43d6-8c85-5c76a402a36e"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:55:07 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:08 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-77c39b8f-6797-447f-895f-b295fc11ffe4 req-8a45787f-5bc0-4ae9-acd9-9f75caa83019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8400cd0-5a21-4ca5-a4b6-1683897941ab", "tag": "444b360c-4e8d-4075-a10a-dca6e73083b0"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:55:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-77c39b8f-6797-447f-895f-b295fc11ffe4 req-8a45787f-5bc0-4ae9-acd9-9f75caa83019 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-77c39b8f-6797-447f-895f-b295fc11ffe4 req-8a45787f-5bc0-4ae9-acd9-9f75caa83019 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-77c39b8f-6797-447f-895f-b295fc11ffe4 req-8a45787f-5bc0-4ae9-acd9-9f75caa83019 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:08 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-77c39b8f-6797-447f-895f-b295fc11ffe4 req-8a45787f-5bc0-4ae9-acd9-9f75caa83019 service nova] Creating event network-changed:444b360c-4e8d-4075-a10a-dca6e73083b0 for instance b8400cd0-5a21-4ca5-a4b6-1683897941ab on user Apr 13 22:55:08 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-77c39b8f-6797-447f-895f-b295fc11ffe4 req-8a45787f-5bc0-4ae9-acd9-9f75caa83019 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031049 Apr 13 22:55:08 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 50/147] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:55:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 22:55:08 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.394307 Apr 13 22:55:08 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 50/148] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:55:07 2023] POST /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:55:10 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-a7d4eef3-b0f5-4078-8e63-948decbf7010 req-4e194ae1-08b8-47ab-844b-3a153c6804d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74b32176-d23e-41cb-80b2-5e8eede9ba7f", "tag": "38a15311-5617-41cd-83a3-b253ee45f5d8"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:55:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a7d4eef3-b0f5-4078-8e63-948decbf7010 req-4e194ae1-08b8-47ab-844b-3a153c6804d3 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a7d4eef3-b0f5-4078-8e63-948decbf7010 req-4e194ae1-08b8-47ab-844b-3a153c6804d3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a7d4eef3-b0f5-4078-8e63-948decbf7010 req-4e194ae1-08b8-47ab-844b-3a153c6804d3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:10 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-a7d4eef3-b0f5-4078-8e63-948decbf7010 req-4e194ae1-08b8-47ab-844b-3a153c6804d3 service nova] Creating event network-changed:38a15311-5617-41cd-83a3-b253ee45f5d8 for instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f on user Apr 13 22:55:10 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-a7d4eef3-b0f5-4078-8e63-948decbf7010 req-4e194ae1-08b8-47ab-844b-3a153c6804d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031456 Apr 13 22:55:10 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 49/149] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:55:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 22:55:10 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "927db7c9-e810-41e1-85b5-306c3505ec50"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:55:10 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:10 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297813 Apr 13 22:55:10 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 51/150] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:55:10 2023] POST /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:55:12 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-7acf4857-5807-4111-831a-bd9a01e0f223 req-157761c1-51af-4674-8cf7-f27d3d3a98c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b32176-d23e-41cb-80b2-5e8eede9ba7f", "name": "network-vif-plugged", "status": "completed", "tag": "38a15311-5617-41cd-83a3-b253ee45f5d8"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:55:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-7acf4857-5807-4111-831a-bd9a01e0f223 req-157761c1-51af-4674-8cf7-f27d3d3a98c3 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-7acf4857-5807-4111-831a-bd9a01e0f223 req-157761c1-51af-4674-8cf7-f27d3d3a98c3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-7acf4857-5807-4111-831a-bd9a01e0f223 req-157761c1-51af-4674-8cf7-f27d3d3a98c3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:12 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-7acf4857-5807-4111-831a-bd9a01e0f223 req-157761c1-51af-4674-8cf7-f27d3d3a98c3 service nova] Creating event network-vif-plugged:38a15311-5617-41cd-83a3-b253ee45f5d8 for instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f on user Apr 13 22:55:12 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-7acf4857-5807-4111-831a-bd9a01e0f223 req-157761c1-51af-4674-8cf7-f27d3d3a98c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037407 Apr 13 22:55:12 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 51/151] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:55:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:55:14 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-198bb3c2-3e61-4f89-9485-1924add8894a req-2332a91d-73cc-49fa-9a39-1654e63e9f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b32176-d23e-41cb-80b2-5e8eede9ba7f", "name": "network-vif-plugged", "status": "completed", "tag": "38a15311-5617-41cd-83a3-b253ee45f5d8"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:55:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-198bb3c2-3e61-4f89-9485-1924add8894a req-2332a91d-73cc-49fa-9a39-1654e63e9f84 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-198bb3c2-3e61-4f89-9485-1924add8894a req-2332a91d-73cc-49fa-9a39-1654e63e9f84 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-198bb3c2-3e61-4f89-9485-1924add8894a req-2332a91d-73cc-49fa-9a39-1654e63e9f84 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:14 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-198bb3c2-3e61-4f89-9485-1924add8894a req-2332a91d-73cc-49fa-9a39-1654e63e9f84 service nova] Creating event network-vif-plugged:38a15311-5617-41cd-83a3-b253ee45f5d8 for instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f on user Apr 13 22:55:14 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-198bb3c2-3e61-4f89-9485-1924add8894a req-2332a91d-73cc-49fa-9a39-1654e63e9f84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030986 Apr 13 22:55:14 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 50/152] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:55:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 22:55:14 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-95ac4f69-e58e-4d84-a89d-1aab47932953 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:14 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-95ac4f69-e58e-4d84-a89d-1aab47932953 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-95ac4f69-e58e-4d84-a89d-1aab47932953 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-95ac4f69-e58e-4d84-a89d-1aab47932953 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-95ac4f69-e58e-4d84-a89d-1aab47932953 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-95ac4f69-e58e-4d84-a89d-1aab47932953 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-95ac4f69-e58e-4d84-a89d-1aab47932953 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-95ac4f69-e58e-4d84-a89d-1aab47932953 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:14 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-95ac4f69-e58e-4d84-a89d-1aab47932953 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.093336 Apr 13 22:55:14 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 52/153] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 22:55:14 2023] GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-interface => generated 283 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:55:16 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e6de0ad8-e529-4539-8615-fc681f075b93 tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e6929797-cf1b-4e85-bc07-364afb8ecf9a"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:55:16 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-e6de0ad8-e529-4539-8615-fc681f075b93 tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e6de0ad8-e529-4539-8615-fc681f075b93 tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e6de0ad8-e529-4539-8615-fc681f075b93 tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e6de0ad8-e529-4539-8615-fc681f075b93 tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e6de0ad8-e529-4539-8615-fc681f075b93 tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e6de0ad8-e529-4539-8615-fc681f075b93 tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e6de0ad8-e529-4539-8615-fc681f075b93 tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:16 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-ef752acc-77d0-4ef0-950b-65d3e9968258 req-86c68367-b7a7-4b46-828b-8ffe40995690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d246d08-7efe-4307-8a37-32f4c0621128", "tag": "603de7bb-7bac-4b93-b74f-d51fb87ffe46"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:55:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-ef752acc-77d0-4ef0-950b-65d3e9968258 req-86c68367-b7a7-4b46-828b-8ffe40995690 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-ef752acc-77d0-4ef0-950b-65d3e9968258 req-86c68367-b7a7-4b46-828b-8ffe40995690 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-ef752acc-77d0-4ef0-950b-65d3e9968258 req-86c68367-b7a7-4b46-828b-8ffe40995690 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:16 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-ef752acc-77d0-4ef0-950b-65d3e9968258 req-86c68367-b7a7-4b46-828b-8ffe40995690 service nova] Creating event network-changed:603de7bb-7bac-4b93-b74f-d51fb87ffe46 for instance 3d246d08-7efe-4307-8a37-32f4c0621128 on user Apr 13 22:55:16 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-ef752acc-77d0-4ef0-950b-65d3e9968258 req-86c68367-b7a7-4b46-828b-8ffe40995690 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034121 Apr 13 22:55:16 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 51/154] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:55:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:55:16 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "188817bf-e42d-4eff-afcf-9471de7a2767"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:55:16 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-e6de0ad8-e529-4539-8615-fc681f075b93 tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] HTTP exception thrown: Volume e6929797-cf1b-4e85-bc07-364afb8ecf9a could not be found. Apr 13 22:55:16 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e6de0ad8-e529-4539-8615-fc681f075b93 tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] Request method failure captured: Apr 13 22:55:16 user devstack@n-api.service[61613]: request: PUT /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063/os-volume_attachments/c927ee17-9542-43d6-8c85-5c76a402a36e HTTP/1.1 Apr 13 22:55:16 user devstack@n-api.service[61613]: Accept: application/json Apr 13 22:55:16 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 22:55:16 user devstack@n-api.service[61613]: Connection: close Apr 13 22:55:16 user devstack@n-api.service[61613]: Content-Length: 74 Apr 13 22:55:16 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 22:55:16 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 22:55:16 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 22:55:16 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 22:55:16 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIfSrXxqjNr5UNoxCuYx53Eo4OECpMlqMbV0ggoe9hj7pyKdR2NhDesZzTnKzvxLwqN9t6O10VkhTLBYbtcO1wRzoEEtwGnJcmi5rnGG_U-QBbG083mFgoZYZYGO6PemhifPaKmCIp8Zfqc89Y3LhoeCjW6OghbeQVIwfvoAQTBM6wM Apr 13 22:55:16 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 22:55:16 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 22:55:16 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 22:55:16 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 22:55:16 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 22:55:16 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 22:55:16 user devstack@n-api.service[61613]: X-Project-Id: cb0978418e294095bfad58844e218d4f Apr 13 22:55:16 user devstack@n-api.service[61613]: X-Project-Name: tempest-VolumesAdminNegativeTest-750754475 Apr 13 22:55:16 user devstack@n-api.service[61613]: X-Role: member,admin,reader Apr 13 22:55:16 user devstack@n-api.service[61613]: X-Roles: member,admin,reader Apr 13 22:55:16 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb0978418e294095bfad58844e218d4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0978418e294095bfad58844e218d4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0978418e294095bfad58844e218d4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:55:16 user devstack@n-api.service[61613]: X-Tenant: tempest-VolumesAdminNegativeTest-750754475 Apr 13 22:55:16 user devstack@n-api.service[61613]: X-Tenant-Id: cb0978418e294095bfad58844e218d4f Apr 13 22:55:16 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-750754475 Apr 13 22:55:16 user devstack@n-api.service[61613]: X-User: tempest-VolumesAdminNegativeTest-750754475-project-admin Apr 13 22:55:16 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 22:55:16 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 22:55:16 user devstack@n-api.service[61613]: X-User-Id: 20a21aae018f47129a7a263cac57e0da Apr 13 22:55:16 user devstack@n-api.service[61613]: X-User-Name: tempest-VolumesAdminNegativeTest-750754475-project-admin Apr 13 22:55:16 user devstack@n-api.service[61613]: Apr 13 22:55:16 user devstack@n-api.service[61613]: {"volumeAttachment": {"volumeId": "e6929797-cf1b-4e85-bc07-364afb8ecf9a"}} Apr 13 22:55:16 user devstack@n-api.service[61613]: method: > Apr 13 22:55:16 user devstack@n-api.service[61613]: exception: Volume e6929797-cf1b-4e85-bc07-364afb8ecf9a could not be found. Apr 13 22:55:16 user devstack@n-api.service[61613]: action_args: {'server_id': '2355fe9d-511a-4e7c-ac2a-5bddc034e063', 'id': 'c927ee17-9542-43d6-8c85-5c76a402a36e', 'body': {'volumeAttachment': {'volumeId': 'e6929797-cf1b-4e85-bc07-364afb8ecf9a'}}} Apr 13 22:55:16 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e6929797-cf1b-4e85-bc07-364afb8ecf9a could not be found. (HTTP 404) (Request-ID: req-9f90890b-d413-49f1-b9fd-c14382af39ab) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e6929797-cf1b-4e85-bc07-364afb8ecf9a could not be found. Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume e6929797-cf1b-4e85-bc07-364afb8ecf9a could not be found. Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e6929797-cf1b-4e85-bc07-364afb8ecf9a could not be found. Apr 13 22:55:16 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:55:16 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e6de0ad8-e529-4539-8615-fc681f075b93 tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] Returning 400 to user: Volume e6929797-cf1b-4e85-bc07-364afb8ecf9a could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:55:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-e6de0ad8-e529-4539-8615-fc681f075b93 tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063/os-volume_attachments/c927ee17-9542-43d6-8c85-5c76a402a36e" status: 400 len: 107 microversion: 2.1 time: 0.562353 Apr 13 22:55:16 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 52/155] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 22:55:15 2023] PUT /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063/os-volume_attachments/c927ee17-9542-43d6-8c85-5c76a402a36e => generated 107 bytes in 564 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 22:55:16 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:16 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:16 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349376 Apr 13 22:55:16 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 53/156] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:55:16 2023] POST /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-volume_attachments => generated 194 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:55:16 user devstack@n-api.service[61612]: DEBUG nova.objects.instance [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lazy-loading 'services' on Instance uuid 2355fe9d-511a-4e7c-ac2a-5bddc034e063 {{(pid=61612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:55:16 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063/os-volume_attachments/c927ee17-9542-43d6-8c85-5c76a402a36e" status: 202 len: 0 microversion: 2.1 time: 0.323583 Apr 13 22:55:16 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 52/157] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 22:55:16 2023] DELETE /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063/os-volume_attachments/c927ee17-9542-43d6-8c85-5c76a402a36e => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:55:16 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e4d71531-c98e-42f8-a589-a506959d2679 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:16 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-e4d71531-c98e-42f8-a589-a506959d2679 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e4d71531-c98e-42f8-a589-a506959d2679 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e4d71531-c98e-42f8-a589-a506959d2679 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e4d71531-c98e-42f8-a589-a506959d2679 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e4d71531-c98e-42f8-a589-a506959d2679 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e4d71531-c98e-42f8-a589-a506959d2679 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e4d71531-c98e-42f8-a589-a506959d2679 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-e4d71531-c98e-42f8-a589-a506959d2679 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052968 Apr 13 22:55:16 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 53/158] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:55:16 2023] GET /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 22:55:18 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:55:18 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=10 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:55:18 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-99e42279-59ba-4ad6-b30e-7599e4b9b267 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:18 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-99e42279-59ba-4ad6-b30e-7599e4b9b267 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-99e42279-59ba-4ad6-b30e-7599e4b9b267 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-99e42279-59ba-4ad6-b30e-7599e4b9b267 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-99e42279-59ba-4ad6-b30e-7599e4b9b267 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-99e42279-59ba-4ad6-b30e-7599e4b9b267 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-99e42279-59ba-4ad6-b30e-7599e4b9b267 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-99e42279-59ba-4ad6-b30e-7599e4b9b267 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-99e42279-59ba-4ad6-b30e-7599e4b9b267 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085916 Apr 13 22:55:18 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 54/159] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:55:18 2023] GET /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:55:18 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:55:18 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:18 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:18 user devstack@n-api.service[61612]: DEBUG nova.objects.instance [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lazy-loading 'services' on Instance uuid b8400cd0-5a21-4ca5-a4b6-1683897941ab {{(pid=61612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:55:18 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:55:18 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab/os-volume_attachments/927db7c9-e810-41e1-85b5-306c3505ec50" status: 202 len: 0 microversion: 2.1 time: 0.187065 Apr 13 22:55:18 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 53/160] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 22:55:18 2023] DELETE /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab/os-volume_attachments/927db7c9-e810-41e1-85b5-306c3505ec50 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:55:21 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-ff9bdb82-583c-4ac6-b5b5-d16b3395f905 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:21 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-ff9bdb82-583c-4ac6-b5b5-d16b3395f905 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:21 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:55:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ff9bdb82-583c-4ac6-b5b5-d16b3395f905 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ff9bdb82-583c-4ac6-b5b5-d16b3395f905 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ff9bdb82-583c-4ac6-b5b5-d16b3395f905 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ff9bdb82-583c-4ac6-b5b5-d16b3395f905 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ff9bdb82-583c-4ac6-b5b5-d16b3395f905 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ff9bdb82-583c-4ac6-b5b5-d16b3395f905 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:21 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-ff9bdb82-583c-4ac6-b5b5-d16b3395f905 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048166 Apr 13 22:55:21 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 54/161] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:55:21 2023] GET /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 22:55:21 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c89aaac9-feca-4613-bda4-b06dc769501a tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:21 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-c89aaac9-feca-4613-bda4-b06dc769501a tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c89aaac9-feca-4613-bda4-b06dc769501a tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c89aaac9-feca-4613-bda4-b06dc769501a tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c89aaac9-feca-4613-bda4-b06dc769501a tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c89aaac9-feca-4613-bda4-b06dc769501a tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c89aaac9-feca-4613-bda4-b06dc769501a tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c89aaac9-feca-4613-bda4-b06dc769501a tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:21 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-c89aaac9-feca-4613-bda4-b06dc769501a tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041660 Apr 13 22:55:21 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 55/162] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:55:21 2023] GET /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 22:55:21 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:21 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:21 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=33 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:55:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:21 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Going to try to terminate instance {{(pid=61612) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:55:21 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab" status: 204 len: 0 microversion: 2.1 time: 0.137296 Apr 13 22:55:21 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 54/163] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:55:21 2023] DELETE /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:55:21 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-709af243-b841-4e60-8894-455732e2a4c7 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:21 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-709af243-b841-4e60-8894-455732e2a4c7 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-709af243-b841-4e60-8894-455732e2a4c7 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-709af243-b841-4e60-8894-455732e2a4c7 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-709af243-b841-4e60-8894-455732e2a4c7 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-709af243-b841-4e60-8894-455732e2a4c7 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-709af243-b841-4e60-8894-455732e2a4c7 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-709af243-b841-4e60-8894-455732e2a4c7 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:21 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-709af243-b841-4e60-8894-455732e2a4c7 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd624ba67e327453881558410a112910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc753ebae6474a4b8a914b240795df82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:55:21 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-709af243-b841-4e60-8894-455732e2a4c7 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab" status: 200 len: 1674 microversion: 2.1 time: 0.172028 Apr 13 22:55:21 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 55/164] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:55:21 2023] GET /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:55:21 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-61a5f2fc-962e-43e8-8c2a-74faecadd5ec req-65f12f04-1690-4222-b0e7-9cf2870bbf1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8400cd0-5a21-4ca5-a4b6-1683897941ab", "name": "network-vif-unplugged", "status": "completed", "tag": "444b360c-4e8d-4075-a10a-dca6e73083b0"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:55:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-61a5f2fc-962e-43e8-8c2a-74faecadd5ec req-65f12f04-1690-4222-b0e7-9cf2870bbf1d service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-61a5f2fc-962e-43e8-8c2a-74faecadd5ec req-65f12f04-1690-4222-b0e7-9cf2870bbf1d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-61a5f2fc-962e-43e8-8c2a-74faecadd5ec req-65f12f04-1690-4222-b0e7-9cf2870bbf1d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:21 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-61a5f2fc-962e-43e8-8c2a-74faecadd5ec req-65f12f04-1690-4222-b0e7-9cf2870bbf1d service nova] Creating event network-vif-unplugged:444b360c-4e8d-4075-a10a-dca6e73083b0 for instance b8400cd0-5a21-4ca5-a4b6-1683897941ab on user Apr 13 22:55:21 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-61a5f2fc-962e-43e8-8c2a-74faecadd5ec req-65f12f04-1690-4222-b0e7-9cf2870bbf1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032600 Apr 13 22:55:21 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 56/165] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:55:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:55:23 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-ad80a3e2-d1a1-49aa-bbb0-963ef0baff9f req-bc481650-d03e-4d5e-bfa6-fe5cdf7dc6da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8400cd0-5a21-4ca5-a4b6-1683897941ab", "name": "network-vif-deleted", "tag": "444b360c-4e8d-4075-a10a-dca6e73083b0"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:55:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-ad80a3e2-d1a1-49aa-bbb0-963ef0baff9f req-bc481650-d03e-4d5e-bfa6-fe5cdf7dc6da service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-ad80a3e2-d1a1-49aa-bbb0-963ef0baff9f req-bc481650-d03e-4d5e-bfa6-fe5cdf7dc6da service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-ad80a3e2-d1a1-49aa-bbb0-963ef0baff9f req-bc481650-d03e-4d5e-bfa6-fe5cdf7dc6da service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:23 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-ad80a3e2-d1a1-49aa-bbb0-963ef0baff9f req-bc481650-d03e-4d5e-bfa6-fe5cdf7dc6da service nova] Creating event network-vif-deleted:444b360c-4e8d-4075-a10a-dca6e73083b0 for instance b8400cd0-5a21-4ca5-a4b6-1683897941ab on user Apr 13 22:55:23 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-ad80a3e2-d1a1-49aa-bbb0-963ef0baff9f req-bc481650-d03e-4d5e-bfa6-fe5cdf7dc6da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033199 Apr 13 22:55:23 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 55/166] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:55:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:55:23 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-2a79fb00-2f13-4b8d-b4d2-6de96b694f1c req-6099bb60-ebcc-4837-a197-92b68eb25acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8400cd0-5a21-4ca5-a4b6-1683897941ab", "name": "network-vif-plugged", "status": "completed", "tag": "444b360c-4e8d-4075-a10a-dca6e73083b0"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:55:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2a79fb00-2f13-4b8d-b4d2-6de96b694f1c req-6099bb60-ebcc-4837-a197-92b68eb25acf service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2a79fb00-2f13-4b8d-b4d2-6de96b694f1c req-6099bb60-ebcc-4837-a197-92b68eb25acf service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2a79fb00-2f13-4b8d-b4d2-6de96b694f1c req-6099bb60-ebcc-4837-a197-92b68eb25acf service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:23 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-2a79fb00-2f13-4b8d-b4d2-6de96b694f1c req-6099bb60-ebcc-4837-a197-92b68eb25acf service nova] Creating event network-vif-plugged:444b360c-4e8d-4075-a10a-dca6e73083b0 for instance b8400cd0-5a21-4ca5-a4b6-1683897941ab on user Apr 13 22:55:23 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-2a79fb00-2f13-4b8d-b4d2-6de96b694f1c req-6099bb60-ebcc-4837-a197-92b68eb25acf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031919 Apr 13 22:55:23 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 56/167] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:55:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:55:24 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "817b6726-2f87-4daa-badf-2d66c3e4fed2"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:55:24 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:24 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-volume_attachments/188817bf-e42d-4eff-afcf-9471de7a2767" status: 202 len: 0 microversion: 2.1 time: 0.412681 Apr 13 22:55:24 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 57/168] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 22:55:23 2023] PUT /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-volume_attachments/188817bf-e42d-4eff-afcf-9471de7a2767 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:55:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-ecc1f5e8-2bba-4f4c-bc57-ca1b9f6ea294 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Calling method '.version_select at 0x7f3d1e1260e0>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-ecc1f5e8-2bba-4f4c-bc57-ca1b9f6ea294 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "GET /compute/v2.1/images/c843b543-e4c9-4201-984c-e4b14f1c0d99" status: 200 len: 1723 microversion: 2.1 time: 0.052908 Apr 13 22:55:27 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 56/169] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 22:55:27 2023] GET /compute/v2.1/images/c843b543-e4c9-4201-984c-e4b14f1c0d99 => generated 1723 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:55:27 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-cf0b4ae3-b507-43db-b0a0-83fccac16226 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Calling method '.version_select at 0x7f3d1e1b0040>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:27 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-cf0b4ae3-b507-43db-b0a0-83fccac16226 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "GET /compute/v2.1/images/c843b543-e4c9-4201-984c-e4b14f1c0d99" status: 200 len: 1723 microversion: 2.1 time: 0.054075 Apr 13 22:55:27 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 57/170] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 22:55:27 2023] GET /compute/v2.1/images/c843b543-e4c9-4201-984c-e4b14f1c0d99 => generated 1723 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:55:27 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-ce35c1ef-eb91-4032-baec-907dd263cd8c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:27 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-ce35c1ef-eb91-4032-baec-907dd263cd8c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ce35c1ef-eb91-4032-baec-907dd263cd8c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ce35c1ef-eb91-4032-baec-907dd263cd8c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ce35c1ef-eb91-4032-baec-907dd263cd8c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ce35c1ef-eb91-4032-baec-907dd263cd8c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ce35c1ef-eb91-4032-baec-907dd263cd8c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ce35c1ef-eb91-4032-baec-907dd263cd8c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:27 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-ce35c1ef-eb91-4032-baec-907dd263cd8c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03ab225421441098f94350bef24442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd502d982f4fe424a8df8149962d46963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:55:27 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-ce35c1ef-eb91-4032-baec-907dd263cd8c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499" status: 200 len: 1669 microversion: 2.1 time: 0.143327 Apr 13 22:55:27 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 58/171] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:55:27 2023] GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499 => generated 1669 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:55:36 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:55:36 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=17,nova_cell1:UPDATE=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:55:36 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-052ecdb8-c411-4684-84e8-66255a142581 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:36 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-052ecdb8-c411-4684-84e8-66255a142581 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:36 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-052ecdb8-c411-4684-84e8-66255a142581 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:36 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-052ecdb8-c411-4684-84e8-66255a142581 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:36 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-052ecdb8-c411-4684-84e8-66255a142581 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:36 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-052ecdb8-c411-4684-84e8-66255a142581 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:36 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-052ecdb8-c411-4684-84e8-66255a142581 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:36 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-052ecdb8-c411-4684-84e8-66255a142581 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:36 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-052ecdb8-c411-4684-84e8-66255a142581 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054321 Apr 13 22:55:36 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 57/172] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:55:36 2023] GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:55:36 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=5 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:55:36 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:55:36 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-c50631f8-901c-4fa3-a9cb-2fdcd7de84f4 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:36 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-c50631f8-901c-4fa3-a9cb-2fdcd7de84f4 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:36 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c50631f8-901c-4fa3-a9cb-2fdcd7de84f4 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:36 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c50631f8-901c-4fa3-a9cb-2fdcd7de84f4 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:36 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c50631f8-901c-4fa3-a9cb-2fdcd7de84f4 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:36 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c50631f8-901c-4fa3-a9cb-2fdcd7de84f4 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:36 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c50631f8-901c-4fa3-a9cb-2fdcd7de84f4 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:36 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c50631f8-901c-4fa3-a9cb-2fdcd7de84f4 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:36 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-c50631f8-901c-4fa3-a9cb-2fdcd7de84f4 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050758 Apr 13 22:55:36 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 58/173] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:55:36 2023] GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:55:36 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "188817bf-e42d-4eff-afcf-9471de7a2767"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:55:36 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:36 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:55:36 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:36 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:36 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:36 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:36 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:36 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:36 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:55:36 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-volume_attachments/817b6726-2f87-4daa-badf-2d66c3e4fed2" status: 202 len: 0 microversion: 2.1 time: 0.343343 Apr 13 22:55:36 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 59/174] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 22:55:36 2023] PUT /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-volume_attachments/817b6726-2f87-4daa-badf-2d66c3e4fed2 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:55:39 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-64429445-7866-45d0-a2cf-f48ef8bf9f23 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:39 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-64429445-7866-45d0-a2cf-f48ef8bf9f23 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-64429445-7866-45d0-a2cf-f48ef8bf9f23 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-64429445-7866-45d0-a2cf-f48ef8bf9f23 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-64429445-7866-45d0-a2cf-f48ef8bf9f23 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-64429445-7866-45d0-a2cf-f48ef8bf9f23 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-64429445-7866-45d0-a2cf-f48ef8bf9f23 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-64429445-7866-45d0-a2cf-f48ef8bf9f23 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:39 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-64429445-7866-45d0-a2cf-f48ef8bf9f23 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:55:39 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-64429445-7866-45d0-a2cf-f48ef8bf9f23 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff417f05-3cfa-4274-a0d9-9145ce1e5f83" status: 200 len: 1491 microversion: 2.1 time: 0.143619 Apr 13 22:55:39 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 58/175] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:55:39 2023] GET /compute/v2.1/servers/ff417f05-3cfa-4274-a0d9-9145ce1e5f83 => generated 1491 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:55:45 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-fc794141-c22e-48d3-b0ed-489ded97a54a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:45 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-fc794141-c22e-48d3-b0ed-489ded97a54a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:45 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fc794141-c22e-48d3-b0ed-489ded97a54a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:45 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fc794141-c22e-48d3-b0ed-489ded97a54a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:45 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fc794141-c22e-48d3-b0ed-489ded97a54a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:45 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fc794141-c22e-48d3-b0ed-489ded97a54a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:45 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fc794141-c22e-48d3-b0ed-489ded97a54a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:45 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fc794141-c22e-48d3-b0ed-489ded97a54a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:45 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-fc794141-c22e-48d3-b0ed-489ded97a54a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] HTTP exception thrown: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. Apr 13 22:55:45 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-fc794141-c22e-48d3-b0ed-489ded97a54a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Request method failure captured: Apr 13 22:55:45 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154 HTTP/1.1 Apr 13 22:55:45 user devstack@n-api.service[61613]: Accept: application/json Apr 13 22:55:45 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 22:55:45 user devstack@n-api.service[61613]: Connection: close Apr 13 22:55:45 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 22:55:45 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 22:55:45 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 22:55:45 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 22:55:45 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 22:55:45 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIfAZHI_UISpzEFHqsiXepQMHi9_zpasybGXOdCWkQUq7GEqTy0gbVpXpad3Vcbyi5XH01A99iOCzctQpbNYD-v_fi7BEThp9IoWctd8dd6xYG4t2izFWAu_Qagyk8eSG5RTSVwQnpdfAbIfIpKbbICsCX-7XiguT8hOq3Jk7m8fvKQ Apr 13 22:55:45 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 22:55:45 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 22:55:45 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 22:55:45 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 22:55:45 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 22:55:45 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 22:55:45 user devstack@n-api.service[61613]: X-Project-Id: 45c86d23c9fa4c60b53700b0798a215f Apr 13 22:55:45 user devstack@n-api.service[61613]: X-Project-Name: tempest-DeleteServersTestJSON-1638372531 Apr 13 22:55:45 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 22:55:45 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 22:55:45 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/45c86d23c9fa4c60b53700b0798a215f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45c86d23c9fa4c60b53700b0798a215f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45c86d23c9fa4c60b53700b0798a215f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:55:45 user devstack@n-api.service[61613]: X-Tenant: tempest-DeleteServersTestJSON-1638372531 Apr 13 22:55:45 user devstack@n-api.service[61613]: X-Tenant-Id: 45c86d23c9fa4c60b53700b0798a215f Apr 13 22:55:45 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-DeleteServersTestJSON-1638372531 Apr 13 22:55:45 user devstack@n-api.service[61613]: X-User: tempest-DeleteServersTestJSON-1638372531-project-member Apr 13 22:55:45 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 22:55:45 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 22:55:45 user devstack@n-api.service[61613]: X-User-Id: bcdd77e681f9467db86ff56ff8f516b4 Apr 13 22:55:45 user devstack@n-api.service[61613]: X-User-Name: tempest-DeleteServersTestJSON-1638372531-project-member Apr 13 22:55:45 user devstack@n-api.service[61613]: method: > Apr 13 22:55:45 user devstack@n-api.service[61613]: exception: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. Apr 13 22:55:45 user devstack@n-api.service[61613]: action_args: {'id': '636a69ed-f9b3-4b91-b371-7f7bf3e85154'} Apr 13 22:55:45 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. Apr 13 22:55:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:55:45 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-fc794141-c22e-48d3-b0ed-489ded97a54a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Returning 404 to user: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:55:45 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-fc794141-c22e-48d3-b0ed-489ded97a54a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154" status: 404 len: 111 microversion: 2.1 time: 0.049521 Apr 13 22:55:45 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 59/176] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:55:45 2023] GET /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:55:45 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b3056f35-8928-40ee-9112-ea68653b7e25 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:45 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-b3056f35-8928-40ee-9112-ea68653b7e25 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b3056f35-8928-40ee-9112-ea68653b7e25 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b3056f35-8928-40ee-9112-ea68653b7e25 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b3056f35-8928-40ee-9112-ea68653b7e25 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b3056f35-8928-40ee-9112-ea68653b7e25 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b3056f35-8928-40ee-9112-ea68653b7e25 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b3056f35-8928-40ee-9112-ea68653b7e25 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:45 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-b3056f35-8928-40ee-9112-ea68653b7e25 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] HTTP exception thrown: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. Apr 13 22:55:45 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b3056f35-8928-40ee-9112-ea68653b7e25 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Request method failure captured: Apr 13 22:55:45 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154/os-volume_attachments HTTP/1.1 Apr 13 22:55:45 user devstack@n-api.service[61611]: Accept: application/json Apr 13 22:55:45 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 22:55:45 user devstack@n-api.service[61611]: Connection: close Apr 13 22:55:45 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 22:55:45 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 22:55:45 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 22:55:45 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 22:55:45 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 22:55:45 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIfAZHI_UISpzEFHqsiXepQMHi9_zpasybGXOdCWkQUq7GEqTy0gbVpXpad3Vcbyi5XH01A99iOCzctQpbNYD-v_fi7BEThp9IoWctd8dd6xYG4t2izFWAu_Qagyk8eSG5RTSVwQnpdfAbIfIpKbbICsCX-7XiguT8hOq3Jk7m8fvKQ Apr 13 22:55:45 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 22:55:45 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 22:55:45 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 22:55:45 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 22:55:45 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 22:55:45 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 22:55:45 user devstack@n-api.service[61611]: X-Project-Id: 45c86d23c9fa4c60b53700b0798a215f Apr 13 22:55:45 user devstack@n-api.service[61611]: X-Project-Name: tempest-DeleteServersTestJSON-1638372531 Apr 13 22:55:45 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 22:55:45 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 22:55:45 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/45c86d23c9fa4c60b53700b0798a215f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45c86d23c9fa4c60b53700b0798a215f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45c86d23c9fa4c60b53700b0798a215f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:55:45 user devstack@n-api.service[61611]: X-Tenant: tempest-DeleteServersTestJSON-1638372531 Apr 13 22:55:45 user devstack@n-api.service[61611]: X-Tenant-Id: 45c86d23c9fa4c60b53700b0798a215f Apr 13 22:55:45 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-DeleteServersTestJSON-1638372531 Apr 13 22:55:45 user devstack@n-api.service[61611]: X-User: tempest-DeleteServersTestJSON-1638372531-project-member Apr 13 22:55:45 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 22:55:45 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 22:55:45 user devstack@n-api.service[61611]: X-User-Id: bcdd77e681f9467db86ff56ff8f516b4 Apr 13 22:55:45 user devstack@n-api.service[61611]: X-User-Name: tempest-DeleteServersTestJSON-1638372531-project-member Apr 13 22:55:45 user devstack@n-api.service[61611]: method: > Apr 13 22:55:45 user devstack@n-api.service[61611]: exception: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. Apr 13 22:55:45 user devstack@n-api.service[61611]: action_args: {'server_id': '636a69ed-f9b3-4b91-b371-7f7bf3e85154'} Apr 13 22:55:45 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. Apr 13 22:55:45 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:55:45 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b3056f35-8928-40ee-9112-ea68653b7e25 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Returning 404 to user: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:55:45 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-b3056f35-8928-40ee-9112-ea68653b7e25 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041790 Apr 13 22:55:45 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 60/177] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:55:45 2023] GET /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:55:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-bc7e4158-1438-4b5e-9a0b-0a93443c2388 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:48 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-bc7e4158-1438-4b5e-9a0b-0a93443c2388 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bc7e4158-1438-4b5e-9a0b-0a93443c2388 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bc7e4158-1438-4b5e-9a0b-0a93443c2388 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bc7e4158-1438-4b5e-9a0b-0a93443c2388 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bc7e4158-1438-4b5e-9a0b-0a93443c2388 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bc7e4158-1438-4b5e-9a0b-0a93443c2388 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bc7e4158-1438-4b5e-9a0b-0a93443c2388 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-bc7e4158-1438-4b5e-9a0b-0a93443c2388 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] HTTP exception thrown: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. Apr 13 22:55:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-bc7e4158-1438-4b5e-9a0b-0a93443c2388 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Request method failure captured: Apr 13 22:55:48 user devstack@n-api.service[61612]: request: DELETE /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154 HTTP/1.1 Apr 13 22:55:48 user devstack@n-api.service[61612]: Accept: application/json Apr 13 22:55:48 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 22:55:48 user devstack@n-api.service[61612]: Connection: close Apr 13 22:55:48 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 22:55:48 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 22:55:48 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 22:55:48 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 22:55:48 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 22:55:48 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIfAZHI_UISpzEFHqsiXepQMHi9_zpasybGXOdCWkQUq7GEqTy0gbVpXpad3Vcbyi5XH01A99iOCzctQpbNYD-v_fi7BEThp9IoWctd8dd6xYG4t2izFWAu_Qagyk8eSG5RTSVwQnpdfAbIfIpKbbICsCX-7XiguT8hOq3Jk7m8fvKQ Apr 13 22:55:48 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 22:55:48 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 22:55:48 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 22:55:48 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 22:55:48 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 22:55:48 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 22:55:48 user devstack@n-api.service[61612]: X-Project-Id: 45c86d23c9fa4c60b53700b0798a215f Apr 13 22:55:48 user devstack@n-api.service[61612]: X-Project-Name: tempest-DeleteServersTestJSON-1638372531 Apr 13 22:55:48 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 22:55:48 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 22:55:48 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/45c86d23c9fa4c60b53700b0798a215f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45c86d23c9fa4c60b53700b0798a215f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45c86d23c9fa4c60b53700b0798a215f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:55:48 user devstack@n-api.service[61612]: X-Tenant: tempest-DeleteServersTestJSON-1638372531 Apr 13 22:55:48 user devstack@n-api.service[61612]: X-Tenant-Id: 45c86d23c9fa4c60b53700b0798a215f Apr 13 22:55:48 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-DeleteServersTestJSON-1638372531 Apr 13 22:55:48 user devstack@n-api.service[61612]: X-User: tempest-DeleteServersTestJSON-1638372531-project-member Apr 13 22:55:48 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 22:55:48 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 22:55:48 user devstack@n-api.service[61612]: X-User-Id: bcdd77e681f9467db86ff56ff8f516b4 Apr 13 22:55:48 user devstack@n-api.service[61612]: X-User-Name: tempest-DeleteServersTestJSON-1638372531-project-member Apr 13 22:55:48 user devstack@n-api.service[61612]: method: > Apr 13 22:55:48 user devstack@n-api.service[61612]: exception: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. Apr 13 22:55:48 user devstack@n-api.service[61612]: action_args: {'id': '636a69ed-f9b3-4b91-b371-7f7bf3e85154'} Apr 13 22:55:48 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. Apr 13 22:55:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:55:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-bc7e4158-1438-4b5e-9a0b-0a93443c2388 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Returning 404 to user: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:55:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-bc7e4158-1438-4b5e-9a0b-0a93443c2388 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154" status: 404 len: 111 microversion: 2.1 time: 0.044826 Apr 13 22:55:48 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 59/178] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:55:48 2023] DELETE /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:55:48 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e73cef3d-43a3-4224-b17a-cff0d9eb4631 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:48 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-e73cef3d-43a3-4224-b17a-cff0d9eb4631 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e73cef3d-43a3-4224-b17a-cff0d9eb4631 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e73cef3d-43a3-4224-b17a-cff0d9eb4631 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e73cef3d-43a3-4224-b17a-cff0d9eb4631 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e73cef3d-43a3-4224-b17a-cff0d9eb4631 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e73cef3d-43a3-4224-b17a-cff0d9eb4631 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e73cef3d-43a3-4224-b17a-cff0d9eb4631 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:48 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-e73cef3d-43a3-4224-b17a-cff0d9eb4631 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] HTTP exception thrown: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. Apr 13 22:55:48 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e73cef3d-43a3-4224-b17a-cff0d9eb4631 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Request method failure captured: Apr 13 22:55:48 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154 HTTP/1.1 Apr 13 22:55:48 user devstack@n-api.service[61613]: Accept: application/json Apr 13 22:55:48 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 22:55:48 user devstack@n-api.service[61613]: Connection: close Apr 13 22:55:48 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 22:55:48 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 22:55:48 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 22:55:48 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 22:55:48 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 22:55:48 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIfAZHI_UISpzEFHqsiXepQMHi9_zpasybGXOdCWkQUq7GEqTy0gbVpXpad3Vcbyi5XH01A99iOCzctQpbNYD-v_fi7BEThp9IoWctd8dd6xYG4t2izFWAu_Qagyk8eSG5RTSVwQnpdfAbIfIpKbbICsCX-7XiguT8hOq3Jk7m8fvKQ Apr 13 22:55:48 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 22:55:48 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 22:55:48 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 22:55:48 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 22:55:48 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 22:55:48 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 22:55:48 user devstack@n-api.service[61613]: X-Project-Id: 45c86d23c9fa4c60b53700b0798a215f Apr 13 22:55:48 user devstack@n-api.service[61613]: X-Project-Name: tempest-DeleteServersTestJSON-1638372531 Apr 13 22:55:48 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 22:55:48 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 22:55:48 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/45c86d23c9fa4c60b53700b0798a215f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45c86d23c9fa4c60b53700b0798a215f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45c86d23c9fa4c60b53700b0798a215f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:55:48 user devstack@n-api.service[61613]: X-Tenant: tempest-DeleteServersTestJSON-1638372531 Apr 13 22:55:48 user devstack@n-api.service[61613]: X-Tenant-Id: 45c86d23c9fa4c60b53700b0798a215f Apr 13 22:55:48 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-DeleteServersTestJSON-1638372531 Apr 13 22:55:48 user devstack@n-api.service[61613]: X-User: tempest-DeleteServersTestJSON-1638372531-project-member Apr 13 22:55:48 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 22:55:48 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 22:55:48 user devstack@n-api.service[61613]: X-User-Id: bcdd77e681f9467db86ff56ff8f516b4 Apr 13 22:55:48 user devstack@n-api.service[61613]: X-User-Name: tempest-DeleteServersTestJSON-1638372531-project-member Apr 13 22:55:48 user devstack@n-api.service[61613]: method: > Apr 13 22:55:48 user devstack@n-api.service[61613]: exception: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. Apr 13 22:55:48 user devstack@n-api.service[61613]: action_args: {'id': '636a69ed-f9b3-4b91-b371-7f7bf3e85154'} Apr 13 22:55:48 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. Apr 13 22:55:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:55:48 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e73cef3d-43a3-4224-b17a-cff0d9eb4631 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Returning 404 to user: Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:55:48 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-e73cef3d-43a3-4224-b17a-cff0d9eb4631 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154" status: 404 len: 111 microversion: 2.1 time: 0.033671 Apr 13 22:55:48 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 60/179] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:55:48 2023] GET /compute/v2.1/servers/636a69ed-f9b3-4b91-b371-7f7bf3e85154 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:55:48 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-519fcbc8-0ac8-45b7-ba02-537f7c04934b tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:48 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-519fcbc8-0ac8-45b7-ba02-537f7c04934b tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-519fcbc8-0ac8-45b7-ba02-537f7c04934b tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-519fcbc8-0ac8-45b7-ba02-537f7c04934b tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-519fcbc8-0ac8-45b7-ba02-537f7c04934b tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-519fcbc8-0ac8-45b7-ba02-537f7c04934b tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-519fcbc8-0ac8-45b7-ba02-537f7c04934b tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-519fcbc8-0ac8-45b7-ba02-537f7c04934b tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:48 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-519fcbc8-0ac8-45b7-ba02-537f7c04934b tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060293 Apr 13 22:55:48 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 61/180] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:55:48 2023] GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:55:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-b356afdb-9a85-4f24-9780-bc7bfaa202cf tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:48 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-b356afdb-9a85-4f24-9780-bc7bfaa202cf tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b356afdb-9a85-4f24-9780-bc7bfaa202cf tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b356afdb-9a85-4f24-9780-bc7bfaa202cf tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b356afdb-9a85-4f24-9780-bc7bfaa202cf tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b356afdb-9a85-4f24-9780-bc7bfaa202cf tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b356afdb-9a85-4f24-9780-bc7bfaa202cf tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b356afdb-9a85-4f24-9780-bc7bfaa202cf tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-b356afdb-9a85-4f24-9780-bc7bfaa202cf tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049750 Apr 13 22:55:48 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 60/181] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:55:48 2023] GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 22:55:48 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:48 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:49 user devstack@n-api.service[61613]: DEBUG nova.objects.instance [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lazy-loading 'services' on Instance uuid 3d246d08-7efe-4307-8a37-32f4c0621128 {{(pid=61613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:55:49 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-volume_attachments/188817bf-e42d-4eff-afcf-9471de7a2767" status: 202 len: 0 microversion: 2.1 time: 0.270832 Apr 13 22:55:49 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 61/182] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 22:55:48 2023] DELETE /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-volume_attachments/188817bf-e42d-4eff-afcf-9471de7a2767 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:55:49 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-70d7211f-1d06-4c03-96ec-c22ceae28547 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:49 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-70d7211f-1d06-4c03-96ec-c22ceae28547 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-70d7211f-1d06-4c03-96ec-c22ceae28547 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-70d7211f-1d06-4c03-96ec-c22ceae28547 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-70d7211f-1d06-4c03-96ec-c22ceae28547 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-70d7211f-1d06-4c03-96ec-c22ceae28547 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-70d7211f-1d06-4c03-96ec-c22ceae28547 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-70d7211f-1d06-4c03-96ec-c22ceae28547 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:49 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-70d7211f-1d06-4c03-96ec-c22ceae28547 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044485 Apr 13 22:55:49 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 62/183] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:55:49 2023] GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:55:49 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-983acf21-9145-4b3e-a27f-127925fab341 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:49 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-983acf21-9145-4b3e-a27f-127925fab341 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-983acf21-9145-4b3e-a27f-127925fab341 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-983acf21-9145-4b3e-a27f-127925fab341 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-983acf21-9145-4b3e-a27f-127925fab341 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-983acf21-9145-4b3e-a27f-127925fab341 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-983acf21-9145-4b3e-a27f-127925fab341 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-983acf21-9145-4b3e-a27f-127925fab341 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:50 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-983acf21-9145-4b3e-a27f-127925fab341 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b46af525dd45678b69207e93683ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0648ea953174a8cae6085ac24d92bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:55:50 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-983acf21-9145-4b3e-a27f-127925fab341 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b" status: 200 len: 1685 microversion: 2.1 time: 0.178628 Apr 13 22:55:50 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 61/184] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:55:49 2023] GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b => generated 1685 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:55:57 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-f9176d76-0a4b-4766-8d7f-a4b64d2ea2f0 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:55:57 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-f9176d76-0a4b-4766-8d7f-a4b64d2ea2f0 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:55:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f9176d76-0a4b-4766-8d7f-a4b64d2ea2f0 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f9176d76-0a4b-4766-8d7f-a4b64d2ea2f0 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f9176d76-0a4b-4766-8d7f-a4b64d2ea2f0 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f9176d76-0a4b-4766-8d7f-a4b64d2ea2f0 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:55:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f9176d76-0a4b-4766-8d7f-a4b64d2ea2f0 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:55:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f9176d76-0a4b-4766-8d7f-a4b64d2ea2f0 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:55:57 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-f9176d76-0a4b-4766-8d7f-a4b64d2ea2f0 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98594f3f6ccf4ffdbfd91bcf192d936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ccac99656842aca44f9f1eb7aa167a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:55:57 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-f9176d76-0a4b-4766-8d7f-a4b64d2ea2f0 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f" status: 200 len: 1544 microversion: 2.1 time: 0.159550 Apr 13 22:55:57 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 62/185] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:55:57 2023] GET /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f => generated 1544 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:56:01 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-91289e6e-cbc8-43e3-9867-d04844b6c6c4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:01 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-91289e6e-cbc8-43e3-9867-d04844b6c6c4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:01 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=7 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:01 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=22,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-91289e6e-cbc8-43e3-9867-d04844b6c6c4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-91289e6e-cbc8-43e3-9867-d04844b6c6c4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-91289e6e-cbc8-43e3-9867-d04844b6c6c4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-91289e6e-cbc8-43e3-9867-d04844b6c6c4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-91289e6e-cbc8-43e3-9867-d04844b6c6c4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-91289e6e-cbc8-43e3-9867-d04844b6c6c4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:01 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-91289e6e-cbc8-43e3-9867-d04844b6c6c4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:56:01 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-91289e6e-cbc8-43e3-9867-d04844b6c6c4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d" status: 200 len: 1380 microversion: 2.1 time: 0.206925 Apr 13 22:56:01 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 63/186] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:56:01 2023] GET /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d => generated 1380 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:56:01 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-447cbfe3-c2c4-4c1f-ab0a-f596a65045c6 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:01 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-447cbfe3-c2c4-4c1f-ab0a-f596a65045c6 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:01 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=10 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:01 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=26 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-447cbfe3-c2c4-4c1f-ab0a-f596a65045c6 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-447cbfe3-c2c4-4c1f-ab0a-f596a65045c6 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-447cbfe3-c2c4-4c1f-ab0a-f596a65045c6 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-447cbfe3-c2c4-4c1f-ab0a-f596a65045c6 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-447cbfe3-c2c4-4c1f-ab0a-f596a65045c6 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-447cbfe3-c2c4-4c1f-ab0a-f596a65045c6 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:01 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-447cbfe3-c2c4-4c1f-ab0a-f596a65045c6 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:56:01 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-447cbfe3-c2c4-4c1f-ab0a-f596a65045c6 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d" status: 200 len: 1380 microversion: 2.1 time: 0.157972 Apr 13 22:56:01 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 62/187] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:56:01 2023] GET /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d => generated 1380 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:56:01 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:01 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:01 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:56:01 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d" status: 204 len: 0 microversion: 2.1 time: 0.134308 Apr 13 22:56:01 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 63/188] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:56:01 2023] DELETE /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:56:01 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-8f0eb583-ffa9-4f91-b0a7-08226cf0f3ca tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:01 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-8f0eb583-ffa9-4f91-b0a7-08226cf0f3ca tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8f0eb583-ffa9-4f91-b0a7-08226cf0f3ca tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8f0eb583-ffa9-4f91-b0a7-08226cf0f3ca tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8f0eb583-ffa9-4f91-b0a7-08226cf0f3ca tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8f0eb583-ffa9-4f91-b0a7-08226cf0f3ca tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8f0eb583-ffa9-4f91-b0a7-08226cf0f3ca tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8f0eb583-ffa9-4f91-b0a7-08226cf0f3ca tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:02 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-8f0eb583-ffa9-4f91-b0a7-08226cf0f3ca tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:56:02 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-8f0eb583-ffa9-4f91-b0a7-08226cf0f3ca tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d" status: 200 len: 1386 microversion: 2.1 time: 0.183978 Apr 13 22:56:02 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 64/189] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:56:01 2023] GET /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d => generated 1386 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:56:02 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-837c3189-0d94-46de-9993-c3bdcfad206e req-71482cf5-1e47-4543-b4e8-889bbbd0b346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a0a6479-bc85-4617-8225-d8169dfb2c8d", "name": "network-vif-unplugged", "status": "completed", "tag": "919802cc-1446-473e-8f73-b2f8a10750ee"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-837c3189-0d94-46de-9993-c3bdcfad206e req-71482cf5-1e47-4543-b4e8-889bbbd0b346 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-837c3189-0d94-46de-9993-c3bdcfad206e req-71482cf5-1e47-4543-b4e8-889bbbd0b346 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-837c3189-0d94-46de-9993-c3bdcfad206e req-71482cf5-1e47-4543-b4e8-889bbbd0b346 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-837c3189-0d94-46de-9993-c3bdcfad206e req-71482cf5-1e47-4543-b4e8-889bbbd0b346 service nova] Creating event network-vif-unplugged:919802cc-1446-473e-8f73-b2f8a10750ee for instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d on user Apr 13 22:56:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-837c3189-0d94-46de-9993-c3bdcfad206e req-71482cf5-1e47-4543-b4e8-889bbbd0b346 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028685 Apr 13 22:56:02 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 63/190] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:56:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:03 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-09ba0011-5864-4be7-90b9-632b03fe16f0 req-7f515ccf-d240-4fe8-a591-c0e5973968e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a0a6479-bc85-4617-8225-d8169dfb2c8d", "name": "network-vif-deleted", "tag": "919802cc-1446-473e-8f73-b2f8a10750ee"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-09ba0011-5864-4be7-90b9-632b03fe16f0 req-7f515ccf-d240-4fe8-a591-c0e5973968e1 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-09ba0011-5864-4be7-90b9-632b03fe16f0 req-7f515ccf-d240-4fe8-a591-c0e5973968e1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-09ba0011-5864-4be7-90b9-632b03fe16f0 req-7f515ccf-d240-4fe8-a591-c0e5973968e1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:03 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-09ba0011-5864-4be7-90b9-632b03fe16f0 req-7f515ccf-d240-4fe8-a591-c0e5973968e1 service nova] Creating event network-vif-deleted:919802cc-1446-473e-8f73-b2f8a10750ee for instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d on user Apr 13 22:56:03 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-09ba0011-5864-4be7-90b9-632b03fe16f0 req-7f515ccf-d240-4fe8-a591-c0e5973968e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030570 Apr 13 22:56:03 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 64/191] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:56:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-312c38bd-2a26-4057-9818-37222e829d36 req-04b709d2-0ae0-4511-aa34-9b95c6e5bde2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a0a6479-bc85-4617-8225-d8169dfb2c8d", "name": "network-vif-plugged", "status": "completed", "tag": "919802cc-1446-473e-8f73-b2f8a10750ee"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-312c38bd-2a26-4057-9818-37222e829d36 req-04b709d2-0ae0-4511-aa34-9b95c6e5bde2 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-312c38bd-2a26-4057-9818-37222e829d36 req-04b709d2-0ae0-4511-aa34-9b95c6e5bde2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-312c38bd-2a26-4057-9818-37222e829d36 req-04b709d2-0ae0-4511-aa34-9b95c6e5bde2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:04 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-312c38bd-2a26-4057-9818-37222e829d36 req-04b709d2-0ae0-4511-aa34-9b95c6e5bde2 service nova] Creating event network-vif-plugged:919802cc-1446-473e-8f73-b2f8a10750ee for instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d on user Apr 13 22:56:04 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-312c38bd-2a26-4057-9818-37222e829d36 req-04b709d2-0ae0-4511-aa34-9b95c6e5bde2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034668 Apr 13 22:56:04 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 65/192] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:56:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:06 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-5561005b-0a79-4792-b475-778cc4839c38 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:06 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-5561005b-0a79-4792-b475-778cc4839c38 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5561005b-0a79-4792-b475-778cc4839c38 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5561005b-0a79-4792-b475-778cc4839c38 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5561005b-0a79-4792-b475-778cc4839c38 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5561005b-0a79-4792-b475-778cc4839c38 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5561005b-0a79-4792-b475-778cc4839c38 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5561005b-0a79-4792-b475-778cc4839c38 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:06 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-5561005b-0a79-4792-b475-778cc4839c38 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046984 Apr 13 22:56:06 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 64/193] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:56:06 2023] GET /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 22:56:06 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1632020151", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "networks": [{"uuid": "778950f1-e25a-4ca7-923c-d73459c36663"}]}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:06 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:07 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] validate_networks() for [('778950f1-e25a-4ca7-923c-d73459c36663', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:56:07 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:56:07 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:56:07 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:56:07 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:56:07 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:56:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:07 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:07 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Getting quotas for project a33cf3bf67714b0ba9c7f703a1c9e5b9. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:56:07 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Getting quotas for user e1b08dea04784bc3b07195f951a84bfb and project a33cf3bf67714b0ba9c7f703a1c9e5b9. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:56:07 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:56:07 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:56:07 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.538630 Apr 13 22:56:07 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 65/194] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:56:06 2023] POST /compute/v2.1/servers => generated 378 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:56:07 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-0b6f3bf7-ee77-4da7-a29b-5aaabab38925 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:07 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-0b6f3bf7-ee77-4da7-a29b-5aaabab38925 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:07 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-0b6f3bf7-ee77-4da7-a29b-5aaabab38925 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b08dea04784bc3b07195f951a84bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33cf3bf67714b0ba9c7f703a1c9e5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:56:07 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-0b6f3bf7-ee77-4da7-a29b-5aaabab38925 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c10b97ca-3231-41fe-9de5-03cd6dc81e07" status: 200 len: 1212 microversion: 2.1 time: 0.151457 Apr 13 22:56:07 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 66/195] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:56:07 2023] GET /compute/v2.1/servers/c10b97ca-3231-41fe-9de5-03cd6dc81e07 => generated 1212 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:56:10 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-07aef02c-27a9-490a-a708-8aace601c0ce req-25de4526-c6db-4af6-9a7f-629f76c43133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c10b97ca-3231-41fe-9de5-03cd6dc81e07", "tag": "d8c122f3-f485-406e-87b1-c547eabd5bf3"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-07aef02c-27a9-490a-a708-8aace601c0ce req-25de4526-c6db-4af6-9a7f-629f76c43133 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-07aef02c-27a9-490a-a708-8aace601c0ce req-25de4526-c6db-4af6-9a7f-629f76c43133 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-07aef02c-27a9-490a-a708-8aace601c0ce req-25de4526-c6db-4af6-9a7f-629f76c43133 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:10 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-07aef02c-27a9-490a-a708-8aace601c0ce req-25de4526-c6db-4af6-9a7f-629f76c43133 service nova] Creating event network-changed:d8c122f3-f485-406e-87b1-c547eabd5bf3 for instance c10b97ca-3231-41fe-9de5-03cd6dc81e07 on user Apr 13 22:56:10 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-07aef02c-27a9-490a-a708-8aace601c0ce req-25de4526-c6db-4af6-9a7f-629f76c43133 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028451 Apr 13 22:56:10 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 65/196] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:56:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:11 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-51fc1e1b-83f4-4a65-a03b-8cdbda4a9dae tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:11 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-51fc1e1b-83f4-4a65-a03b-8cdbda4a9dae tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-51fc1e1b-83f4-4a65-a03b-8cdbda4a9dae tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-51fc1e1b-83f4-4a65-a03b-8cdbda4a9dae tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-51fc1e1b-83f4-4a65-a03b-8cdbda4a9dae tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-51fc1e1b-83f4-4a65-a03b-8cdbda4a9dae tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-51fc1e1b-83f4-4a65-a03b-8cdbda4a9dae tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-51fc1e1b-83f4-4a65-a03b-8cdbda4a9dae tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:11 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-51fc1e1b-83f4-4a65-a03b-8cdbda4a9dae tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] HTTP exception thrown: Instance b8400cd0-5a21-4ca5-a4b6-1683897941ab could not be found. Apr 13 22:56:11 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-51fc1e1b-83f4-4a65-a03b-8cdbda4a9dae tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Request method failure captured: Apr 13 22:56:11 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab HTTP/1.1 Apr 13 22:56:11 user devstack@n-api.service[61613]: Accept: application/json Apr 13 22:56:11 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 22:56:11 user devstack@n-api.service[61613]: Connection: close Apr 13 22:56:11 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 22:56:11 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 22:56:11 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 22:56:11 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 22:56:11 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 22:56:11 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIe_C7COR5Mfc_ZKZRCXW7I0GGS4Fy6Iu2oF5dhNksScKvOORl7bi6ldHYCbzBKuRI_RiLjakySieIyKIoSF4yP3NmWCWL3RFexiHeg4V2IM9fGH7p85UTWXPYIVoVXPcwVjPkea1TJBi3UktJZIwWBB9UOn1zsdmdQ79FfixzKEsgk Apr 13 22:56:11 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 22:56:11 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 22:56:11 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 22:56:11 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 22:56:11 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 22:56:11 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 22:56:11 user devstack@n-api.service[61613]: X-Project-Id: cc753ebae6474a4b8a914b240795df82 Apr 13 22:56:11 user devstack@n-api.service[61613]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-791951707 Apr 13 22:56:11 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 22:56:11 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 22:56:11 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc753ebae6474a4b8a914b240795df82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc753ebae6474a4b8a914b240795df82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc753ebae6474a4b8a914b240795df82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:56:11 user devstack@n-api.service[61613]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-791951707 Apr 13 22:56:11 user devstack@n-api.service[61613]: X-Tenant-Id: cc753ebae6474a4b8a914b240795df82 Apr 13 22:56:11 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-791951707 Apr 13 22:56:11 user devstack@n-api.service[61613]: X-User: tempest-AttachSCSIVolumeTestJSON-791951707-project-member Apr 13 22:56:11 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 22:56:11 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 22:56:11 user devstack@n-api.service[61613]: X-User-Id: d624ba67e327453881558410a112910a Apr 13 22:56:11 user devstack@n-api.service[61613]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-791951707-project-member Apr 13 22:56:11 user devstack@n-api.service[61613]: method: > Apr 13 22:56:11 user devstack@n-api.service[61613]: exception: Instance b8400cd0-5a21-4ca5-a4b6-1683897941ab could not be found. Apr 13 22:56:11 user devstack@n-api.service[61613]: action_args: {'id': 'b8400cd0-5a21-4ca5-a4b6-1683897941ab'} Apr 13 22:56:11 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8400cd0-5a21-4ca5-a4b6-1683897941ab could not be found. Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8400cd0-5a21-4ca5-a4b6-1683897941ab could not be found. Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8400cd0-5a21-4ca5-a4b6-1683897941ab could not be found. Apr 13 22:56:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:56:11 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-51fc1e1b-83f4-4a65-a03b-8cdbda4a9dae tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Returning 404 to user: Instance b8400cd0-5a21-4ca5-a4b6-1683897941ab could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:56:11 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-51fc1e1b-83f4-4a65-a03b-8cdbda4a9dae tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab" status: 404 len: 111 microversion: 2.1 time: 0.029681 Apr 13 22:56:11 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 66/197] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:56:11 2023] GET /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:56:11 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5ad4d042-2aea-4e1f-a10a-37e97f94d561 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Calling method '.version_select at 0x7f3d1e16ab90>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-5ad4d042-2aea-4e1f-a10a-37e97f94d561 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-864897906" status: 202 len: 0 microversion: 2.1 time: 0.026605 Apr 13 22:56:11 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 67/198] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 22:56:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-864897906 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:56:13 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-b0da474f-66ac-4529-993d-16c9cc829a9f req-d234e7c9-83d1-4d6b-8a26-dac5179025a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10b97ca-3231-41fe-9de5-03cd6dc81e07", "name": "network-vif-plugged", "status": "completed", "tag": "d8c122f3-f485-406e-87b1-c547eabd5bf3"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b0da474f-66ac-4529-993d-16c9cc829a9f req-d234e7c9-83d1-4d6b-8a26-dac5179025a1 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b0da474f-66ac-4529-993d-16c9cc829a9f req-d234e7c9-83d1-4d6b-8a26-dac5179025a1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b0da474f-66ac-4529-993d-16c9cc829a9f req-d234e7c9-83d1-4d6b-8a26-dac5179025a1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:13 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-b0da474f-66ac-4529-993d-16c9cc829a9f req-d234e7c9-83d1-4d6b-8a26-dac5179025a1 service nova] Creating event network-vif-plugged:d8c122f3-f485-406e-87b1-c547eabd5bf3 for instance c10b97ca-3231-41fe-9de5-03cd6dc81e07 on user Apr 13 22:56:13 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-b0da474f-66ac-4529-993d-16c9cc829a9f req-d234e7c9-83d1-4d6b-8a26-dac5179025a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033356 Apr 13 22:56:13 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 66/199] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:56:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:15 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-c5e6c772-a035-47f9-a734-a01f618fa995 req-3cc56cb3-385a-4f92-bedb-4f79fc3e04e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10b97ca-3231-41fe-9de5-03cd6dc81e07", "name": "network-vif-plugged", "status": "completed", "tag": "d8c122f3-f485-406e-87b1-c547eabd5bf3"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c5e6c772-a035-47f9-a734-a01f618fa995 req-3cc56cb3-385a-4f92-bedb-4f79fc3e04e8 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c5e6c772-a035-47f9-a734-a01f618fa995 req-3cc56cb3-385a-4f92-bedb-4f79fc3e04e8 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c5e6c772-a035-47f9-a734-a01f618fa995 req-3cc56cb3-385a-4f92-bedb-4f79fc3e04e8 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:15 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-c5e6c772-a035-47f9-a734-a01f618fa995 req-3cc56cb3-385a-4f92-bedb-4f79fc3e04e8 service nova] Creating event network-vif-plugged:d8c122f3-f485-406e-87b1-c547eabd5bf3 for instance c10b97ca-3231-41fe-9de5-03cd6dc81e07 on user Apr 13 22:56:15 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-c5e6c772-a035-47f9-a734-a01f618fa995 req-3cc56cb3-385a-4f92-bedb-4f79fc3e04e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035058 Apr 13 22:56:15 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 67/200] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:56:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:15 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=14 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:15 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b41953ba-2284-43a2-a189-6f16435eb083 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:15 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-b41953ba-2284-43a2-a189-6f16435eb083 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b41953ba-2284-43a2-a189-6f16435eb083 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b41953ba-2284-43a2-a189-6f16435eb083 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b41953ba-2284-43a2-a189-6f16435eb083 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b41953ba-2284-43a2-a189-6f16435eb083 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b41953ba-2284-43a2-a189-6f16435eb083 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b41953ba-2284-43a2-a189-6f16435eb083 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:15 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-b41953ba-2284-43a2-a189-6f16435eb083 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] HTTP exception thrown: Instance b8400cd0-5a21-4ca5-a4b6-1683897941ab could not be found. Apr 13 22:56:15 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b41953ba-2284-43a2-a189-6f16435eb083 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Request method failure captured: Apr 13 22:56:15 user devstack@n-api.service[61611]: request: DELETE /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab HTTP/1.1 Apr 13 22:56:15 user devstack@n-api.service[61611]: Accept: application/json Apr 13 22:56:15 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 22:56:15 user devstack@n-api.service[61611]: Connection: close Apr 13 22:56:15 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 22:56:15 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 22:56:15 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 22:56:15 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 22:56:15 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 22:56:15 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIe_C7COR5Mfc_ZKZRCXW7I0GGS4Fy6Iu2oF5dhNksScKvOORl7bi6ldHYCbzBKuRI_RiLjakySieIyKIoSF4yP3NmWCWL3RFexiHeg4V2IM9fGH7p85UTWXPYIVoVXPcwVjPkea1TJBi3UktJZIwWBB9UOn1zsdmdQ79FfixzKEsgk Apr 13 22:56:15 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 22:56:15 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 22:56:15 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 22:56:15 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 22:56:15 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 22:56:15 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 22:56:15 user devstack@n-api.service[61611]: X-Project-Id: cc753ebae6474a4b8a914b240795df82 Apr 13 22:56:15 user devstack@n-api.service[61611]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-791951707 Apr 13 22:56:15 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 22:56:15 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 22:56:15 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc753ebae6474a4b8a914b240795df82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc753ebae6474a4b8a914b240795df82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc753ebae6474a4b8a914b240795df82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:56:15 user devstack@n-api.service[61611]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-791951707 Apr 13 22:56:15 user devstack@n-api.service[61611]: X-Tenant-Id: cc753ebae6474a4b8a914b240795df82 Apr 13 22:56:15 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-791951707 Apr 13 22:56:15 user devstack@n-api.service[61611]: X-User: tempest-AttachSCSIVolumeTestJSON-791951707-project-member Apr 13 22:56:15 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 22:56:15 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 22:56:15 user devstack@n-api.service[61611]: X-User-Id: d624ba67e327453881558410a112910a Apr 13 22:56:15 user devstack@n-api.service[61611]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-791951707-project-member Apr 13 22:56:15 user devstack@n-api.service[61611]: method: > Apr 13 22:56:15 user devstack@n-api.service[61611]: exception: Instance b8400cd0-5a21-4ca5-a4b6-1683897941ab could not be found. Apr 13 22:56:15 user devstack@n-api.service[61611]: action_args: {'id': 'b8400cd0-5a21-4ca5-a4b6-1683897941ab'} Apr 13 22:56:15 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8400cd0-5a21-4ca5-a4b6-1683897941ab could not be found. Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8400cd0-5a21-4ca5-a4b6-1683897941ab could not be found. Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8400cd0-5a21-4ca5-a4b6-1683897941ab could not be found. Apr 13 22:56:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:56:15 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b41953ba-2284-43a2-a189-6f16435eb083 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Returning 404 to user: Instance b8400cd0-5a21-4ca5-a4b6-1683897941ab could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:56:15 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-b41953ba-2284-43a2-a189-6f16435eb083 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab" status: 404 len: 111 microversion: 2.1 time: 0.047314 Apr 13 22:56:15 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 68/201] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:56:15 2023] DELETE /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:56:15 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-fdfcd281-46ea-4e04-ac5e-c6ff128e2584 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:15 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-fdfcd281-46ea-4e04-ac5e-c6ff128e2584 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fdfcd281-46ea-4e04-ac5e-c6ff128e2584 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fdfcd281-46ea-4e04-ac5e-c6ff128e2584 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fdfcd281-46ea-4e04-ac5e-c6ff128e2584 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fdfcd281-46ea-4e04-ac5e-c6ff128e2584 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fdfcd281-46ea-4e04-ac5e-c6ff128e2584 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fdfcd281-46ea-4e04-ac5e-c6ff128e2584 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:15 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-fdfcd281-46ea-4e04-ac5e-c6ff128e2584 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] HTTP exception thrown: Instance b8400cd0-5a21-4ca5-a4b6-1683897941ab could not be found. Apr 13 22:56:15 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-fdfcd281-46ea-4e04-ac5e-c6ff128e2584 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Request method failure captured: Apr 13 22:56:15 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab HTTP/1.1 Apr 13 22:56:15 user devstack@n-api.service[61612]: Accept: application/json Apr 13 22:56:15 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 22:56:15 user devstack@n-api.service[61612]: Connection: close Apr 13 22:56:15 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 22:56:15 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 22:56:15 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 22:56:15 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 22:56:15 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 22:56:15 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIe_C7COR5Mfc_ZKZRCXW7I0GGS4Fy6Iu2oF5dhNksScKvOORl7bi6ldHYCbzBKuRI_RiLjakySieIyKIoSF4yP3NmWCWL3RFexiHeg4V2IM9fGH7p85UTWXPYIVoVXPcwVjPkea1TJBi3UktJZIwWBB9UOn1zsdmdQ79FfixzKEsgk Apr 13 22:56:15 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 22:56:15 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 22:56:15 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 22:56:15 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 22:56:15 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 22:56:15 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 22:56:15 user devstack@n-api.service[61612]: X-Project-Id: cc753ebae6474a4b8a914b240795df82 Apr 13 22:56:15 user devstack@n-api.service[61612]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-791951707 Apr 13 22:56:15 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 22:56:15 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 22:56:15 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc753ebae6474a4b8a914b240795df82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc753ebae6474a4b8a914b240795df82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc753ebae6474a4b8a914b240795df82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:56:15 user devstack@n-api.service[61612]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-791951707 Apr 13 22:56:15 user devstack@n-api.service[61612]: X-Tenant-Id: cc753ebae6474a4b8a914b240795df82 Apr 13 22:56:15 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-791951707 Apr 13 22:56:15 user devstack@n-api.service[61612]: X-User: tempest-AttachSCSIVolumeTestJSON-791951707-project-member Apr 13 22:56:15 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 22:56:15 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 22:56:15 user devstack@n-api.service[61612]: X-User-Id: d624ba67e327453881558410a112910a Apr 13 22:56:15 user devstack@n-api.service[61612]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-791951707-project-member Apr 13 22:56:15 user devstack@n-api.service[61612]: method: > Apr 13 22:56:15 user devstack@n-api.service[61612]: exception: Instance b8400cd0-5a21-4ca5-a4b6-1683897941ab could not be found. Apr 13 22:56:15 user devstack@n-api.service[61612]: action_args: {'id': 'b8400cd0-5a21-4ca5-a4b6-1683897941ab'} Apr 13 22:56:15 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8400cd0-5a21-4ca5-a4b6-1683897941ab could not be found. Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8400cd0-5a21-4ca5-a4b6-1683897941ab could not be found. Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8400cd0-5a21-4ca5-a4b6-1683897941ab could not be found. Apr 13 22:56:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:56:15 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-fdfcd281-46ea-4e04-ac5e-c6ff128e2584 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Returning 404 to user: Instance b8400cd0-5a21-4ca5-a4b6-1683897941ab could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:56:15 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-fdfcd281-46ea-4e04-ac5e-c6ff128e2584 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab" status: 404 len: 111 microversion: 2.1 time: 0.042147 Apr 13 22:56:15 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 67/202] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:56:15 2023] GET /compute/v2.1/servers/b8400cd0-5a21-4ca5-a4b6-1683897941ab => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:56:28 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:28 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:28 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=3 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:28 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=5 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:28 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-c030b8aa-fad5-42c4-9e46-f4436bbf3ed5 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:28 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-c030b8aa-fad5-42c4-9e46-f4436bbf3ed5 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c030b8aa-fad5-42c4-9e46-f4436bbf3ed5 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c030b8aa-fad5-42c4-9e46-f4436bbf3ed5 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c030b8aa-fad5-42c4-9e46-f4436bbf3ed5 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c030b8aa-fad5-42c4-9e46-f4436bbf3ed5 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c030b8aa-fad5-42c4-9e46-f4436bbf3ed5 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c030b8aa-fad5-42c4-9e46-f4436bbf3ed5 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:28 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-c030b8aa-fad5-42c4-9e46-f4436bbf3ed5 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03ab225421441098f94350bef24442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd502d982f4fe424a8df8149962d46963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:56:28 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-c030b8aa-fad5-42c4-9e46-f4436bbf3ed5 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499" status: 200 len: 1669 microversion: 2.1 time: 0.180477 Apr 13 22:56:28 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 68/203] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:56:28 2023] GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499 => generated 1669 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:56:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad4438c6-dc98-4b87-b570-3881b3bde779"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:30 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:30 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:30 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:30 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:31 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304140 Apr 13 22:56:31 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 69/204] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:56:30 2023] POST /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:31 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=12 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:31 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=20 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:32 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1319911046", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "networks": [{"uuid": "7ea834aa-c724-45fb-9c3f-497360beab67"}]}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:32 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] validate_networks() for [('7ea834aa-c724-45fb-9c3f-497360beab67', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:56:32 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:56:32 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:56:32 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:56:32 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:56:32 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:56:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:32 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Getting quotas for project 3fe77a2c491c4596ba7e6af3236d7de8. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:56:32 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Getting quotas for user 6db44e7cb89a46c2999916b0a266b159 and project 3fe77a2c491c4596ba7e6af3236d7de8. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:56:32 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:56:32 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:56:32 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.152727 Apr 13 22:56:32 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 68/205] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 22:56:31 2023] POST /compute/v2.1/servers => generated 378 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 22:56:32 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-d1e2fedf-fc14-4e30-ba5f-3e6e5b7cdaa3 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:32 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-d1e2fedf-fc14-4e30-ba5f-3e6e5b7cdaa3 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:33 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-d1e2fedf-fc14-4e30-ba5f-3e6e5b7cdaa3 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:56:33 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-d1e2fedf-fc14-4e30-ba5f-3e6e5b7cdaa3 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:56:33 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-d1e2fedf-fc14-4e30-ba5f-3e6e5b7cdaa3 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:56:33 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-d1e2fedf-fc14-4e30-ba5f-3e6e5b7cdaa3 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7226cc11-4c2c-4a27-bb02-87ba1f749d33" status: 200 len: 1395 microversion: 2.87 time: 0.112487 Apr 13 22:56:33 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 69/206] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:56:32 2023] GET /compute/v2.1/servers/7226cc11-4c2c-4a27-bb02-87ba1f749d33 => generated 1395 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 22:56:35 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-38272fcc-ca7e-43ae-88a8-b474e625d5fa req-f0d08e41-6e84-45c9-98fd-cce4b7a58bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7226cc11-4c2c-4a27-bb02-87ba1f749d33", "tag": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-38272fcc-ca7e-43ae-88a8-b474e625d5fa req-f0d08e41-6e84-45c9-98fd-cce4b7a58bd4 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-38272fcc-ca7e-43ae-88a8-b474e625d5fa req-f0d08e41-6e84-45c9-98fd-cce4b7a58bd4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-38272fcc-ca7e-43ae-88a8-b474e625d5fa req-f0d08e41-6e84-45c9-98fd-cce4b7a58bd4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-38272fcc-ca7e-43ae-88a8-b474e625d5fa req-f0d08e41-6e84-45c9-98fd-cce4b7a58bd4 service nova] Creating event network-changed:eefcee78-4e09-44b9-ad0c-7b7ee693a6fb for instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 on user Apr 13 22:56:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-38272fcc-ca7e-43ae-88a8-b474e625d5fa req-f0d08e41-6e84-45c9-98fd-cce4b7a58bd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029335 Apr 13 22:56:35 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 70/207] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:56:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:38 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-a4dd536b-f1e9-4dfb-9300-4a4485700791 req-e23f5c26-72e5-41d8-8265-f47fcdf644e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7226cc11-4c2c-4a27-bb02-87ba1f749d33", "name": "network-vif-plugged", "status": "completed", "tag": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a4dd536b-f1e9-4dfb-9300-4a4485700791 req-e23f5c26-72e5-41d8-8265-f47fcdf644e4 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a4dd536b-f1e9-4dfb-9300-4a4485700791 req-e23f5c26-72e5-41d8-8265-f47fcdf644e4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a4dd536b-f1e9-4dfb-9300-4a4485700791 req-e23f5c26-72e5-41d8-8265-f47fcdf644e4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:38 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-a4dd536b-f1e9-4dfb-9300-4a4485700791 req-e23f5c26-72e5-41d8-8265-f47fcdf644e4 service nova] Creating event network-vif-plugged:eefcee78-4e09-44b9-ad0c-7b7ee693a6fb for instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 on user Apr 13 22:56:38 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-a4dd536b-f1e9-4dfb-9300-4a4485700791 req-e23f5c26-72e5-41d8-8265-f47fcdf644e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039530 Apr 13 22:56:38 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 69/208] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:56:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:38 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "c843b543-e4c9-4201-984c-e4b14f1c0d99"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:38 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:38 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:38 user devstack@n-api.service[61613]: DEBUG nova.objects.instance [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lazy-loading 'flavor' on Instance uuid 3f241623-e618-42eb-87d1-0606e37ec499 {{(pid=61613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:56:38 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499/action" status: 200 len: 29 microversion: 2.1 time: 0.221048 Apr 13 22:56:38 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 70/209] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 22:56:38 2023] POST /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499/action => generated 29 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 22:56:38 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-3ce40dde-718f-46fa-975c-89739bc0d738 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:38 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-3ce40dde-718f-46fa-975c-89739bc0d738 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3ce40dde-718f-46fa-975c-89739bc0d738 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3ce40dde-718f-46fa-975c-89739bc0d738 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3ce40dde-718f-46fa-975c-89739bc0d738 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3ce40dde-718f-46fa-975c-89739bc0d738 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3ce40dde-718f-46fa-975c-89739bc0d738 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3ce40dde-718f-46fa-975c-89739bc0d738 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:39 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-a8f367bb-8073-40e9-8d20-729ffaeddeba tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:39 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-a8f367bb-8073-40e9-8d20-729ffaeddeba tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a8f367bb-8073-40e9-8d20-729ffaeddeba tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a8f367bb-8073-40e9-8d20-729ffaeddeba tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a8f367bb-8073-40e9-8d20-729ffaeddeba tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a8f367bb-8073-40e9-8d20-729ffaeddeba tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a8f367bb-8073-40e9-8d20-729ffaeddeba tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a8f367bb-8073-40e9-8d20-729ffaeddeba tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:39 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-3ce40dde-718f-46fa-975c-89739bc0d738 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03ab225421441098f94350bef24442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd502d982f4fe424a8df8149962d46963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:56:39 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-3ce40dde-718f-46fa-975c-89739bc0d738 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499" status: 200 len: 1721 microversion: 2.1 time: 0.492209 Apr 13 22:56:39 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 71/210] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:56:38 2023] GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499 => generated 1721 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 22:56:39 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-a8f367bb-8073-40e9-8d20-729ffaeddeba tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.143254 Apr 13 22:56:39 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 70/211] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:56:39 2023] GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 22:56:39 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:39 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:39 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:56:39 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128" status: 204 len: 0 microversion: 2.1 time: 0.129301 Apr 13 22:56:39 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 71/212] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:56:39 2023] DELETE /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:56:39 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-a6477a97-bdf4-4380-a60b-ffeddcba86e3 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:39 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-a6477a97-bdf4-4380-a60b-ffeddcba86e3 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a6477a97-bdf4-4380-a60b-ffeddcba86e3 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a6477a97-bdf4-4380-a60b-ffeddcba86e3 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a6477a97-bdf4-4380-a60b-ffeddcba86e3 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a6477a97-bdf4-4380-a60b-ffeddcba86e3 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a6477a97-bdf4-4380-a60b-ffeddcba86e3 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a6477a97-bdf4-4380-a60b-ffeddcba86e3 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:39 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-7107194a-92f6-40d8-9dcd-a4f7387a5325 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:39 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-7107194a-92f6-40d8-9dcd-a4f7387a5325 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7107194a-92f6-40d8-9dcd-a4f7387a5325 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7107194a-92f6-40d8-9dcd-a4f7387a5325 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7107194a-92f6-40d8-9dcd-a4f7387a5325 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7107194a-92f6-40d8-9dcd-a4f7387a5325 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7107194a-92f6-40d8-9dcd-a4f7387a5325 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7107194a-92f6-40d8-9dcd-a4f7387a5325 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:39 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-a6477a97-bdf4-4380-a60b-ffeddcba86e3 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20751f66f6564d04807dc09a675aef70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f871045289a43d18b339d3dac4d0666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:56:39 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-a6477a97-bdf4-4380-a60b-ffeddcba86e3 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128" status: 200 len: 1649 microversion: 2.1 time: 0.256624 Apr 13 22:56:39 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 72/213] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:56:39 2023] GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128 => generated 1649 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:56:40 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-435c8914-3acb-4ac2-a71c-7d3963d48a33 req-e2063403-768d-457c-9d08-8ec55dc80808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f241623-e618-42eb-87d1-0606e37ec499", "name": "network-vif-unplugged", "status": "completed", "tag": "87e984d6-f653-4e7e-a230-53cd27a17d97"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:40 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-435c8914-3acb-4ac2-a71c-7d3963d48a33 req-e2063403-768d-457c-9d08-8ec55dc80808 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:40 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-435c8914-3acb-4ac2-a71c-7d3963d48a33 req-e2063403-768d-457c-9d08-8ec55dc80808 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:40 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-435c8914-3acb-4ac2-a71c-7d3963d48a33 req-e2063403-768d-457c-9d08-8ec55dc80808 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:40 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-435c8914-3acb-4ac2-a71c-7d3963d48a33 req-e2063403-768d-457c-9d08-8ec55dc80808 service nova] Creating event network-vif-unplugged:87e984d6-f653-4e7e-a230-53cd27a17d97 for instance 3f241623-e618-42eb-87d1-0606e37ec499 on user Apr 13 22:56:40 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-435c8914-3acb-4ac2-a71c-7d3963d48a33 req-e2063403-768d-457c-9d08-8ec55dc80808 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038523 Apr 13 22:56:40 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 72/214] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:56:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:40 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-7107194a-92f6-40d8-9dcd-a4f7387a5325 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:56:40 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-7107194a-92f6-40d8-9dcd-a4f7387a5325 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555" status: 200 len: 1505 microversion: 2.1 time: 0.226970 Apr 13 22:56:40 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 71/215] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:56:39 2023] GET /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555 => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:56:40 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-64b21c92-d945-49fa-87c4-5fe2c7dad78c req-337c3660-362c-44b5-82ce-034a966d3e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7226cc11-4c2c-4a27-bb02-87ba1f749d33", "name": "network-vif-plugged", "status": "completed", "tag": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-64b21c92-d945-49fa-87c4-5fe2c7dad78c req-337c3660-362c-44b5-82ce-034a966d3e73 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-64b21c92-d945-49fa-87c4-5fe2c7dad78c req-337c3660-362c-44b5-82ce-034a966d3e73 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-64b21c92-d945-49fa-87c4-5fe2c7dad78c req-337c3660-362c-44b5-82ce-034a966d3e73 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:40 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-64b21c92-d945-49fa-87c4-5fe2c7dad78c req-337c3660-362c-44b5-82ce-034a966d3e73 service nova] Creating event network-vif-plugged:eefcee78-4e09-44b9-ad0c-7b7ee693a6fb for instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 on user Apr 13 22:56:40 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-64b21c92-d945-49fa-87c4-5fe2c7dad78c req-337c3660-362c-44b5-82ce-034a966d3e73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031602 Apr 13 22:56:40 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 73/216] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:56:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:42 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f241623-e618-42eb-87d1-0606e37ec499", "name": "network-vif-plugged", "status": "completed", "tag": "87e984d6-f653-4e7e-a230-53cd27a17d97"}, {"server_uuid": "3d246d08-7efe-4307-8a37-32f4c0621128", "name": "network-vif-unplugged", "status": "completed", "tag": "603de7bb-7bac-4b93-b74f-d51fb87ffe46"}, {"server_uuid": "3d246d08-7efe-4307-8a37-32f4c0621128", "name": "network-vif-plugged", "status": "completed", "tag": "603de7bb-7bac-4b93-b74f-d51fb87ffe46"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:42 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] Creating event network-vif-plugged:87e984d6-f653-4e7e-a230-53cd27a17d97 for instance 3f241623-e618-42eb-87d1-0606e37ec499 on user Apr 13 22:56:42 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] Creating event network-vif-unplugged:603de7bb-7bac-4b93-b74f-d51fb87ffe46 for instance 3d246d08-7efe-4307-8a37-32f4c0621128 on user Apr 13 22:56:42 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] Creating event network-vif-plugged:603de7bb-7bac-4b93-b74f-d51fb87ffe46 for instance 3d246d08-7efe-4307-8a37-32f4c0621128 on user Apr 13 22:56:42 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.124121 Apr 13 22:56:42 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 73/217] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:56:42 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:43 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:43 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:43 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-18ccff89-d125-4eea-a2dc-fc31920ad605 req-e23535db-9a08-4271-b134-1cba8fc71309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d246d08-7efe-4307-8a37-32f4c0621128", "name": "network-vif-deleted", "tag": "603de7bb-7bac-4b93-b74f-d51fb87ffe46"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-18ccff89-d125-4eea-a2dc-fc31920ad605 req-e23535db-9a08-4271-b134-1cba8fc71309 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-18ccff89-d125-4eea-a2dc-fc31920ad605 req-e23535db-9a08-4271-b134-1cba8fc71309 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-18ccff89-d125-4eea-a2dc-fc31920ad605 req-e23535db-9a08-4271-b134-1cba8fc71309 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:43 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-18ccff89-d125-4eea-a2dc-fc31920ad605 req-e23535db-9a08-4271-b134-1cba8fc71309 service nova] Creating event network-vif-deleted:603de7bb-7bac-4b93-b74f-d51fb87ffe46 for instance 3d246d08-7efe-4307-8a37-32f4c0621128 on user Apr 13 22:56:43 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-18ccff89-d125-4eea-a2dc-fc31920ad605 req-e23535db-9a08-4271-b134-1cba8fc71309 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042037 Apr 13 22:56:43 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 72/218] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:56:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 22:56:45 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-2d429155-e22a-44cf-a2bf-9d6e07303a79 req-85175d51-d4f6-4d54-b925-26d84a4a4a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f241623-e618-42eb-87d1-0606e37ec499", "name": "network-vif-plugged", "status": "completed", "tag": "87e984d6-f653-4e7e-a230-53cd27a17d97"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-2d429155-e22a-44cf-a2bf-9d6e07303a79 req-85175d51-d4f6-4d54-b925-26d84a4a4a4e service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-2d429155-e22a-44cf-a2bf-9d6e07303a79 req-85175d51-d4f6-4d54-b925-26d84a4a4a4e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-2d429155-e22a-44cf-a2bf-9d6e07303a79 req-85175d51-d4f6-4d54-b925-26d84a4a4a4e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:45 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-2d429155-e22a-44cf-a2bf-9d6e07303a79 req-85175d51-d4f6-4d54-b925-26d84a4a4a4e service nova] Creating event network-vif-plugged:87e984d6-f653-4e7e-a230-53cd27a17d97 for instance 3f241623-e618-42eb-87d1-0606e37ec499 on user Apr 13 22:56:45 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-2d429155-e22a-44cf-a2bf-9d6e07303a79 req-85175d51-d4f6-4d54-b925-26d84a4a4a4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032289 Apr 13 22:56:45 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 74/219] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:56:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:47 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-4ab454a9-f86b-4f51-8c34-257847337359 req-90f66631-278b-475a-ad41-d776e1617ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f241623-e618-42eb-87d1-0606e37ec499", "name": "network-vif-plugged", "status": "completed", "tag": "87e984d6-f653-4e7e-a230-53cd27a17d97"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:47 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4ab454a9-f86b-4f51-8c34-257847337359 req-90f66631-278b-475a-ad41-d776e1617ce5 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4ab454a9-f86b-4f51-8c34-257847337359 req-90f66631-278b-475a-ad41-d776e1617ce5 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4ab454a9-f86b-4f51-8c34-257847337359 req-90f66631-278b-475a-ad41-d776e1617ce5 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:47 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-4ab454a9-f86b-4f51-8c34-257847337359 req-90f66631-278b-475a-ad41-d776e1617ce5 service nova] Creating event network-vif-plugged:87e984d6-f653-4e7e-a230-53cd27a17d97 for instance 3f241623-e618-42eb-87d1-0606e37ec499 on user Apr 13 22:56:47 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-4ab454a9-f86b-4f51-8c34-257847337359 req-90f66631-278b-475a-ad41-d776e1617ce5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030999 Apr 13 22:56:47 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 74/220] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:56:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:50 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:50 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Going to try to start instance {{(pid=61612) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 13 22:56:50 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "POST /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b/action" status: 202 len: 0 microversion: 2.1 time: 0.332601 Apr 13 22:56:50 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 73/221] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 22:56:50 2023] POST /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:56:50 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-68a87087-dd33-4cbb-87c1-23e322fdf71c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:50 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-68a87087-dd33-4cbb-87c1-23e322fdf71c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-68a87087-dd33-4cbb-87c1-23e322fdf71c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-68a87087-dd33-4cbb-87c1-23e322fdf71c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-68a87087-dd33-4cbb-87c1-23e322fdf71c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-68a87087-dd33-4cbb-87c1-23e322fdf71c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-68a87087-dd33-4cbb-87c1-23e322fdf71c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-68a87087-dd33-4cbb-87c1-23e322fdf71c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:50 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-68a87087-dd33-4cbb-87c1-23e322fdf71c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b46af525dd45678b69207e93683ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0648ea953174a8cae6085ac24d92bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:56:50 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-68a87087-dd33-4cbb-87c1-23e322fdf71c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b" status: 200 len: 1694 microversion: 2.1 time: 0.203170 Apr 13 22:56:50 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 75/222] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:56:50 2023] GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b => generated 1694 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:56:52 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-fc2b57bc-8c75-4d40-90ff-cd0451355209 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:52 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-fc2b57bc-8c75-4d40-90ff-cd0451355209 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fc2b57bc-8c75-4d40-90ff-cd0451355209 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fc2b57bc-8c75-4d40-90ff-cd0451355209 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fc2b57bc-8c75-4d40-90ff-cd0451355209 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fc2b57bc-8c75-4d40-90ff-cd0451355209 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fc2b57bc-8c75-4d40-90ff-cd0451355209 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fc2b57bc-8c75-4d40-90ff-cd0451355209 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:52 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-fc2b57bc-8c75-4d40-90ff-cd0451355209 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] HTTP exception thrown: Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d could not be found. Apr 13 22:56:52 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-fc2b57bc-8c75-4d40-90ff-cd0451355209 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Request method failure captured: Apr 13 22:56:52 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d HTTP/1.1 Apr 13 22:56:52 user devstack@n-api.service[61613]: Accept: application/json Apr 13 22:56:52 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 22:56:52 user devstack@n-api.service[61613]: Connection: close Apr 13 22:56:52 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 22:56:52 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 22:56:52 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 22:56:52 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 22:56:52 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 22:56:52 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIgE6Gl7ZSFkA-_Uvg9_1wPLldz_ScwHJLtH7XfCRP3AC2MJmMpZ7l9bcSBPK09rKumFcFKFuRTWt2Sf1d4N5k3NQaJGxn8JzsH44PLD5fzCs7WE6phnuUwwFlbCj4pm_qJgudGzAbO1tRiQjdcyEvfY3Ke0cXzXFHfEZxyouzAaMTk Apr 13 22:56:52 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 22:56:52 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 22:56:52 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 22:56:52 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 22:56:52 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 22:56:52 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 22:56:52 user devstack@n-api.service[61613]: X-Project-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 22:56:52 user devstack@n-api.service[61613]: X-Project-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 22:56:52 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 22:56:52 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 22:56:52 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:56:52 user devstack@n-api.service[61613]: X-Tenant: tempest-TestVolumeBootPattern-751187467 Apr 13 22:56:52 user devstack@n-api.service[61613]: X-Tenant-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 22:56:52 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 22:56:52 user devstack@n-api.service[61613]: X-User: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 22:56:52 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 22:56:52 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 22:56:52 user devstack@n-api.service[61613]: X-User-Id: b289294050af4c41aeef8401832487a1 Apr 13 22:56:52 user devstack@n-api.service[61613]: X-User-Name: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 22:56:52 user devstack@n-api.service[61613]: method: > Apr 13 22:56:52 user devstack@n-api.service[61613]: exception: Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d could not be found. Apr 13 22:56:52 user devstack@n-api.service[61613]: action_args: {'id': '4a0a6479-bc85-4617-8225-d8169dfb2c8d'} Apr 13 22:56:52 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d could not be found. Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d could not be found. Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d could not be found. Apr 13 22:56:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:56:52 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-fc2b57bc-8c75-4d40-90ff-cd0451355209 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Returning 404 to user: Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:56:52 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-fc2b57bc-8c75-4d40-90ff-cd0451355209 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d" status: 404 len: 111 microversion: 2.1 time: 0.054864 Apr 13 22:56:52 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 75/223] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:56:52 2023] GET /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:56:52 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-4dc6a1c6-e813-493b-85d6-b8acae7c8e09 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:52 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-4dc6a1c6-e813-493b-85d6-b8acae7c8e09 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4dc6a1c6-e813-493b-85d6-b8acae7c8e09 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4dc6a1c6-e813-493b-85d6-b8acae7c8e09 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4dc6a1c6-e813-493b-85d6-b8acae7c8e09 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4dc6a1c6-e813-493b-85d6-b8acae7c8e09 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4dc6a1c6-e813-493b-85d6-b8acae7c8e09 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4dc6a1c6-e813-493b-85d6-b8acae7c8e09 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:52 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-4dc6a1c6-e813-493b-85d6-b8acae7c8e09 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] HTTP exception thrown: Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d could not be found. Apr 13 22:56:52 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-4dc6a1c6-e813-493b-85d6-b8acae7c8e09 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Request method failure captured: Apr 13 22:56:52 user devstack@n-api.service[61612]: request: DELETE /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d HTTP/1.1 Apr 13 22:56:52 user devstack@n-api.service[61612]: Accept: application/json Apr 13 22:56:52 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 22:56:52 user devstack@n-api.service[61612]: Connection: close Apr 13 22:56:52 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 22:56:52 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 22:56:52 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 22:56:52 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 22:56:52 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 22:56:52 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIgE6Gl7ZSFkA-_Uvg9_1wPLldz_ScwHJLtH7XfCRP3AC2MJmMpZ7l9bcSBPK09rKumFcFKFuRTWt2Sf1d4N5k3NQaJGxn8JzsH44PLD5fzCs7WE6phnuUwwFlbCj4pm_qJgudGzAbO1tRiQjdcyEvfY3Ke0cXzXFHfEZxyouzAaMTk Apr 13 22:56:52 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 22:56:52 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 22:56:52 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 22:56:52 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 22:56:52 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 22:56:52 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 22:56:52 user devstack@n-api.service[61612]: X-Project-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 22:56:52 user devstack@n-api.service[61612]: X-Project-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 22:56:52 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 22:56:52 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 22:56:52 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:56:52 user devstack@n-api.service[61612]: X-Tenant: tempest-TestVolumeBootPattern-751187467 Apr 13 22:56:52 user devstack@n-api.service[61612]: X-Tenant-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 22:56:52 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 22:56:52 user devstack@n-api.service[61612]: X-User: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 22:56:52 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 22:56:52 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 22:56:52 user devstack@n-api.service[61612]: X-User-Id: b289294050af4c41aeef8401832487a1 Apr 13 22:56:52 user devstack@n-api.service[61612]: X-User-Name: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 22:56:52 user devstack@n-api.service[61612]: method: > Apr 13 22:56:52 user devstack@n-api.service[61612]: exception: Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d could not be found. Apr 13 22:56:52 user devstack@n-api.service[61612]: action_args: {'id': '4a0a6479-bc85-4617-8225-d8169dfb2c8d'} Apr 13 22:56:52 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d could not be found. Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d could not be found. Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d could not be found. Apr 13 22:56:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:56:52 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-4dc6a1c6-e813-493b-85d6-b8acae7c8e09 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Returning 404 to user: Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:56:52 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-4dc6a1c6-e813-493b-85d6-b8acae7c8e09 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d" status: 404 len: 111 microversion: 2.1 time: 0.027735 Apr 13 22:56:52 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 74/224] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:56:52 2023] DELETE /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:56:52 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d0edfd5b-ca5f-41cf-83e6-aa62cfa2e29a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:52 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-d0edfd5b-ca5f-41cf-83e6-aa62cfa2e29a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0edfd5b-ca5f-41cf-83e6-aa62cfa2e29a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0edfd5b-ca5f-41cf-83e6-aa62cfa2e29a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0edfd5b-ca5f-41cf-83e6-aa62cfa2e29a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0edfd5b-ca5f-41cf-83e6-aa62cfa2e29a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0edfd5b-ca5f-41cf-83e6-aa62cfa2e29a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0edfd5b-ca5f-41cf-83e6-aa62cfa2e29a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:52 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-d0edfd5b-ca5f-41cf-83e6-aa62cfa2e29a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] HTTP exception thrown: Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d could not be found. Apr 13 22:56:52 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d0edfd5b-ca5f-41cf-83e6-aa62cfa2e29a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Request method failure captured: Apr 13 22:56:52 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d HTTP/1.1 Apr 13 22:56:52 user devstack@n-api.service[61611]: Accept: application/json Apr 13 22:56:52 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 22:56:52 user devstack@n-api.service[61611]: Connection: close Apr 13 22:56:52 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 22:56:52 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 22:56:52 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 22:56:52 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 22:56:52 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 22:56:52 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIgE6Gl7ZSFkA-_Uvg9_1wPLldz_ScwHJLtH7XfCRP3AC2MJmMpZ7l9bcSBPK09rKumFcFKFuRTWt2Sf1d4N5k3NQaJGxn8JzsH44PLD5fzCs7WE6phnuUwwFlbCj4pm_qJgudGzAbO1tRiQjdcyEvfY3Ke0cXzXFHfEZxyouzAaMTk Apr 13 22:56:52 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 22:56:52 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 22:56:52 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 22:56:52 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 22:56:52 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 22:56:52 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 22:56:52 user devstack@n-api.service[61611]: X-Project-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 22:56:52 user devstack@n-api.service[61611]: X-Project-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 22:56:52 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 22:56:52 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 22:56:52 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:56:52 user devstack@n-api.service[61611]: X-Tenant: tempest-TestVolumeBootPattern-751187467 Apr 13 22:56:52 user devstack@n-api.service[61611]: X-Tenant-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 22:56:52 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 22:56:52 user devstack@n-api.service[61611]: X-User: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 22:56:52 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 22:56:52 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 22:56:52 user devstack@n-api.service[61611]: X-User-Id: b289294050af4c41aeef8401832487a1 Apr 13 22:56:52 user devstack@n-api.service[61611]: X-User-Name: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 22:56:52 user devstack@n-api.service[61611]: method: > Apr 13 22:56:52 user devstack@n-api.service[61611]: exception: Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d could not be found. Apr 13 22:56:52 user devstack@n-api.service[61611]: action_args: {'id': '4a0a6479-bc85-4617-8225-d8169dfb2c8d'} Apr 13 22:56:52 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d could not be found. Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d could not be found. Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d could not be found. Apr 13 22:56:52 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:56:52 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d0edfd5b-ca5f-41cf-83e6-aa62cfa2e29a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Returning 404 to user: Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:56:52 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-d0edfd5b-ca5f-41cf-83e6-aa62cfa2e29a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d" status: 404 len: 111 microversion: 2.1 time: 0.030682 Apr 13 22:56:52 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 76/225] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:56:52 2023] GET /compute/v2.1/servers/4a0a6479-bc85-4617-8225-d8169dfb2c8d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:56:53 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8fb9112c-8403-4e4b-a99c-991070265ce3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Action: 'create', calling method: .version_select at 0x7f3d1df85cf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1486131087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtgXoWxAxDyqtpEaZ6qyW9uFinkc74wYRhX75QmNd3vBCY/1sKwsXtNiybFOUXArf5K7l/6NgGA8NhciQ3r5iyBdwkb4azHGVTrBBkzOPQ19E6AZBW7SmSTh0Xg7qdsSg=="}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:53 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-8fb9112c-8403-4e4b-a99c-991070265ce3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Getting quotas for project cf532d1c87a34b8cbde0f162688f7cdb. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:56:53 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-8fb9112c-8403-4e4b-a99c-991070265ce3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Getting quotas for user fad76e3a6e154feaa62d95f6e7d1ce1c and project cf532d1c87a34b8cbde0f162688f7cdb. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:56:53 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-8fb9112c-8403-4e4b-a99c-991070265ce3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054593 Apr 13 22:56:53 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 76/226] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 22:56:53 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:53 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1582878166", "imageRef": "bd4ff522-0822-422c-8f3d-ad6afaa48909", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1486131087", "networks": [{"uuid": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a"}]}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:53 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] validate_networks() for [('31c239a4-3745-4a30-8ac2-820d7bdc9e2a', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:56:53 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:56:53 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:56:53 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:56:53 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:56:53 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:56:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:53 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Getting quotas for project cf532d1c87a34b8cbde0f162688f7cdb. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:56:53 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Getting quotas for user fad76e3a6e154feaa62d95f6e7d1ce1c and project cf532d1c87a34b8cbde0f162688f7cdb. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:56:53 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:56:53 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd4ff522-0822-422c-8f3d-ad6afaa48909',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:56:53 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.568173 Apr 13 22:56:53 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 75/227] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:56:53 2023] POST /compute/v2.1/servers => generated 378 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:56:53 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-0ca6cd51-086b-4f99-a608-b638380696b5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:53 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-0ca6cd51-086b-4f99-a608-b638380696b5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:53 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-0ca6cd51-086b-4f99-a608-b638380696b5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:56:53 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-0ca6cd51-086b-4f99-a608-b638380696b5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138" status: 200 len: 1253 microversion: 2.1 time: 0.076597 Apr 13 22:56:53 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 77/228] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:56:53 2023] GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138 => generated 1253 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:56:55 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-da708548-e4dd-4f5e-ad23-9ab9ba58ba15 req-12377bef-b76e-4c55-9094-e0408d9a77d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e1fa88-8896-4198-af4d-56d44baf3b9b", "name": "network-vif-plugged", "status": "completed", "tag": "94c47f47-2ee7-46d0-858d-a5ff3270a80b"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-da708548-e4dd-4f5e-ad23-9ab9ba58ba15 req-12377bef-b76e-4c55-9094-e0408d9a77d7 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-da708548-e4dd-4f5e-ad23-9ab9ba58ba15 req-12377bef-b76e-4c55-9094-e0408d9a77d7 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-da708548-e4dd-4f5e-ad23-9ab9ba58ba15 req-12377bef-b76e-4c55-9094-e0408d9a77d7 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:55 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-da708548-e4dd-4f5e-ad23-9ab9ba58ba15 req-12377bef-b76e-4c55-9094-e0408d9a77d7 service nova] Creating event network-vif-plugged:94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b on user Apr 13 22:56:55 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-da708548-e4dd-4f5e-ad23-9ab9ba58ba15 req-12377bef-b76e-4c55-9094-e0408d9a77d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067206 Apr 13 22:56:55 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 77/229] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:56:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:57 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-8de9cb61-ace5-4f4c-8c30-c013249f3298 req-72af72b5-9d16-4743-8915-3bb1b18f9ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b190941d-9f62-41ef-881d-e02d246e9138", "tag": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-8de9cb61-ace5-4f4c-8c30-c013249f3298 req-72af72b5-9d16-4743-8915-3bb1b18f9ec4 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-8de9cb61-ace5-4f4c-8c30-c013249f3298 req-72af72b5-9d16-4743-8915-3bb1b18f9ec4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-8de9cb61-ace5-4f4c-8c30-c013249f3298 req-72af72b5-9d16-4743-8915-3bb1b18f9ec4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:57 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-8de9cb61-ace5-4f4c-8c30-c013249f3298 req-72af72b5-9d16-4743-8915-3bb1b18f9ec4 service nova] Creating event network-changed:37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance b190941d-9f62-41ef-881d-e02d246e9138 on user Apr 13 22:56:57 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-8de9cb61-ace5-4f4c-8c30-c013249f3298 req-72af72b5-9d16-4743-8915-3bb1b18f9ec4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031936 Apr 13 22:56:57 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 76/230] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:56:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:57 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-a4ad86fd-4d6c-42eb-a11c-44b44e0ab52a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:57 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-a4ad86fd-4d6c-42eb-a11c-44b44e0ab52a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a4ad86fd-4d6c-42eb-a11c-44b44e0ab52a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a4ad86fd-4d6c-42eb-a11c-44b44e0ab52a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a4ad86fd-4d6c-42eb-a11c-44b44e0ab52a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a4ad86fd-4d6c-42eb-a11c-44b44e0ab52a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a4ad86fd-4d6c-42eb-a11c-44b44e0ab52a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a4ad86fd-4d6c-42eb-a11c-44b44e0ab52a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:57 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-a4ad86fd-4d6c-42eb-a11c-44b44e0ab52a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.093841 Apr 13 22:56:57 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 78/231] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 22:56:57 2023] GET /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f/os-interface => generated 282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:57 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-95a90624-46e0-4af6-be96-e607c33ca9a3 req-76d7e629-e4a4-40a5-bf2c-d840a2a891d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e1fa88-8896-4198-af4d-56d44baf3b9b", "name": "network-vif-plugged", "status": "completed", "tag": "94c47f47-2ee7-46d0-858d-a5ff3270a80b"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-95a90624-46e0-4af6-be96-e607c33ca9a3 req-76d7e629-e4a4-40a5-bf2c-d840a2a891d5 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-95a90624-46e0-4af6-be96-e607c33ca9a3 req-76d7e629-e4a4-40a5-bf2c-d840a2a891d5 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-95a90624-46e0-4af6-be96-e607c33ca9a3 req-76d7e629-e4a4-40a5-bf2c-d840a2a891d5 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:57 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-95a90624-46e0-4af6-be96-e607c33ca9a3 req-76d7e629-e4a4-40a5-bf2c-d840a2a891d5 service nova] Creating event network-vif-plugged:94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b on user Apr 13 22:56:57 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-95a90624-46e0-4af6-be96-e607c33ca9a3 req-76d7e629-e4a4-40a5-bf2c-d840a2a891d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077317 Apr 13 22:56:57 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 78/232] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:56:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:57 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-529f829a-2276-4c20-b92c-2b3eff0d1fd8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:57 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-529f829a-2276-4c20-b92c-2b3eff0d1fd8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-529f829a-2276-4c20-b92c-2b3eff0d1fd8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-529f829a-2276-4c20-b92c-2b3eff0d1fd8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-529f829a-2276-4c20-b92c-2b3eff0d1fd8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-529f829a-2276-4c20-b92c-2b3eff0d1fd8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-529f829a-2276-4c20-b92c-2b3eff0d1fd8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-529f829a-2276-4c20-b92c-2b3eff0d1fd8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:57 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-529f829a-2276-4c20-b92c-2b3eff0d1fd8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b08dea04784bc3b07195f951a84bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33cf3bf67714b0ba9c7f703a1c9e5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:56:57 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-529f829a-2276-4c20-b92c-2b3eff0d1fd8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c10b97ca-3231-41fe-9de5-03cd6dc81e07" status: 200 len: 1495 microversion: 2.1 time: 0.238492 Apr 13 22:56:57 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 77/233] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:56:57 2023] GET /compute/v2.1/servers/c10b97ca-3231-41fe-9de5-03cd6dc81e07 => generated 1495 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:56:58 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-05d5c704-ca8f-41c0-8ec3-8d8b13e0285d req-d82e6753-a64f-4879-b319-703520bd673d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74b32176-d23e-41cb-80b2-5e8eede9ba7f", "tag": "38a15311-5617-41cd-83a3-b253ee45f5d8"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-05d5c704-ca8f-41c0-8ec3-8d8b13e0285d req-d82e6753-a64f-4879-b319-703520bd673d service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-05d5c704-ca8f-41c0-8ec3-8d8b13e0285d req-d82e6753-a64f-4879-b319-703520bd673d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-05d5c704-ca8f-41c0-8ec3-8d8b13e0285d req-d82e6753-a64f-4879-b319-703520bd673d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-05d5c704-ca8f-41c0-8ec3-8d8b13e0285d req-d82e6753-a64f-4879-b319-703520bd673d service nova] Creating event network-changed:38a15311-5617-41cd-83a3-b253ee45f5d8 for instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f on user Apr 13 22:56:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-05d5c704-ca8f-41c0-8ec3-8d8b13e0285d req-d82e6753-a64f-4879-b319-703520bd673d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053990 Apr 13 22:56:58 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 79/234] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:56:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:58 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-00579456-e8aa-4f25-80db-08aabdfc2fcf tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:58 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-00579456-e8aa-4f25-80db-08aabdfc2fcf tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:58 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:56:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-00579456-e8aa-4f25-80db-08aabdfc2fcf tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-00579456-e8aa-4f25-80db-08aabdfc2fcf tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-00579456-e8aa-4f25-80db-08aabdfc2fcf tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-00579456-e8aa-4f25-80db-08aabdfc2fcf tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-00579456-e8aa-4f25-80db-08aabdfc2fcf tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-00579456-e8aa-4f25-80db-08aabdfc2fcf tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:58 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-00579456-e8aa-4f25-80db-08aabdfc2fcf tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f/ips" status: 200 len: 108 microversion: 2.1 time: 0.076298 Apr 13 22:56:58 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 79/235] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 22:56:58 2023] GET /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f/ips => generated 108 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:56:58 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-2bb3eb24-9a85-4919-8729-97bf89114d5d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "098aedca-2822-4384-bff5-58cccb0f96a0"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:58 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-2bb3eb24-9a85-4919-8729-97bf89114d5d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2bb3eb24-9a85-4919-8729-97bf89114d5d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2bb3eb24-9a85-4919-8729-97bf89114d5d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2bb3eb24-9a85-4919-8729-97bf89114d5d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2bb3eb24-9a85-4919-8729-97bf89114d5d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2bb3eb24-9a85-4919-8729-97bf89114d5d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2bb3eb24-9a85-4919-8729-97bf89114d5d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:58 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-2bb3eb24-9a85-4919-8729-97bf89114d5d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] HTTP exception thrown: Invalid volume: volume 098aedca-2822-4384-bff5-58cccb0f96a0 is already attached to instances: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 Apr 13 22:56:58 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-2bb3eb24-9a85-4919-8729-97bf89114d5d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Request method failure captured: Apr 13 22:56:58 user devstack@n-api.service[61612]: request: POST /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f/os-volume_attachments HTTP/1.1 Apr 13 22:56:58 user devstack@n-api.service[61612]: Accept: application/json Apr 13 22:56:58 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 22:56:58 user devstack@n-api.service[61612]: Connection: close Apr 13 22:56:58 user devstack@n-api.service[61612]: Content-Length: 74 Apr 13 22:56:58 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 22:56:58 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 22:56:58 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 22:56:58 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 22:56:58 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIfFTd-GGuNLZhpg908qNRAUWwxNgAfeCUimfaNa0b2DAb_GHBW4t-lVsJou0tz2or0f6bqUrzjLpozKP8y8w6AYyySvjwkcbo4hPrDnlFVSF3sjpEAKCireroRzn4mK7Mj_j8ZmmwDUGWxo3vQ2pAQyz117nhwbP810jFnZYlkUbLs Apr 13 22:56:58 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 22:56:58 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 22:56:58 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 22:56:58 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 22:56:58 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 22:56:58 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 22:56:58 user devstack@n-api.service[61612]: X-Project-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 22:56:58 user devstack@n-api.service[61612]: X-Project-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 22:56:58 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 22:56:58 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 22:56:58 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:56:58 user devstack@n-api.service[61612]: X-Tenant: tempest-AttachVolumeNegativeTest-704876090 Apr 13 22:56:58 user devstack@n-api.service[61612]: X-Tenant-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 22:56:58 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 22:56:58 user devstack@n-api.service[61612]: X-User: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 22:56:58 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 22:56:58 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 22:56:58 user devstack@n-api.service[61612]: X-User-Id: 98594f3f6ccf4ffdbfd91bcf192d936e Apr 13 22:56:58 user devstack@n-api.service[61612]: X-User-Name: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 22:56:58 user devstack@n-api.service[61612]: Apr 13 22:56:58 user devstack@n-api.service[61612]: {"volumeAttachment": {"volumeId": "098aedca-2822-4384-bff5-58cccb0f96a0"}} Apr 13 22:56:58 user devstack@n-api.service[61612]: method: > Apr 13 22:56:58 user devstack@n-api.service[61612]: exception: Invalid volume: volume 098aedca-2822-4384-bff5-58cccb0f96a0 is already attached to instances: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 Apr 13 22:56:58 user devstack@n-api.service[61612]: action_args: {'server_id': '74b32176-d23e-41cb-80b2-5e8eede9ba7f', 'body': {'volumeAttachment': {'volumeId': '098aedca-2822-4384-bff5-58cccb0f96a0'}}} Apr 13 22:56:58 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 098aedca-2822-4384-bff5-58cccb0f96a0 is already attached to instances: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 098aedca-2822-4384-bff5-58cccb0f96a0 is already attached to instances: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 098aedca-2822-4384-bff5-58cccb0f96a0 is already attached to instances: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 Apr 13 22:56:58 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:56:58 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-2bb3eb24-9a85-4919-8729-97bf89114d5d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Returning 400 to user: Invalid volume: volume 098aedca-2822-4384-bff5-58cccb0f96a0 is already attached to instances: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:56:58 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-2bb3eb24-9a85-4919-8729-97bf89114d5d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "POST /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.116084 Apr 13 22:56:58 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 78/236] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:56:58 2023] POST /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f/os-volume_attachments => generated 174 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 22:56:58 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:58 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:58 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:56:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f" status: 204 len: 0 microversion: 2.1 time: 0.147944 Apr 13 22:56:58 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 80/237] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:56:58 2023] DELETE /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:56:58 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-45a12e08-d867-419e-a312-3a568efb9c27 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:56:58 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-45a12e08-d867-419e-a312-3a568efb9c27 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:56:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-45a12e08-d867-419e-a312-3a568efb9c27 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-45a12e08-d867-419e-a312-3a568efb9c27 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-45a12e08-d867-419e-a312-3a568efb9c27 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-45a12e08-d867-419e-a312-3a568efb9c27 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-45a12e08-d867-419e-a312-3a568efb9c27 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-45a12e08-d867-419e-a312-3a568efb9c27 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:59 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-45a12e08-d867-419e-a312-3a568efb9c27 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98594f3f6ccf4ffdbfd91bcf192d936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ccac99656842aca44f9f1eb7aa167a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:56:59 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-45a12e08-d867-419e-a312-3a568efb9c27 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f" status: 200 len: 1550 microversion: 2.1 time: 0.223151 Apr 13 22:56:59 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 80/238] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:56:58 2023] GET /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f => generated 1550 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:56:59 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-95a2976f-9d11-4e61-8ea0-ee81ae13daba req-8b0b324a-329f-4fe9-9180-aa27337c4b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b32176-d23e-41cb-80b2-5e8eede9ba7f", "name": "network-vif-unplugged", "status": "completed", "tag": "38a15311-5617-41cd-83a3-b253ee45f5d8"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:56:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-95a2976f-9d11-4e61-8ea0-ee81ae13daba req-8b0b324a-329f-4fe9-9180-aa27337c4b21 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:56:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-95a2976f-9d11-4e61-8ea0-ee81ae13daba req-8b0b324a-329f-4fe9-9180-aa27337c4b21 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:56:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-95a2976f-9d11-4e61-8ea0-ee81ae13daba req-8b0b324a-329f-4fe9-9180-aa27337c4b21 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:56:59 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-95a2976f-9d11-4e61-8ea0-ee81ae13daba req-8b0b324a-329f-4fe9-9180-aa27337c4b21 service nova] Creating event network-vif-unplugged:38a15311-5617-41cd-83a3-b253ee45f5d8 for instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f on user Apr 13 22:56:59 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-95a2976f-9d11-4e61-8ea0-ee81ae13daba req-8b0b324a-329f-4fe9-9180-aa27337c4b21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057898 Apr 13 22:56:59 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 79/239] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:56:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:57:00 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-7c58e986-ede2-437f-b5ea-ec3e43d42248 req-11b4467d-616b-4080-9833-7c72180b7ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b190941d-9f62-41ef-881d-e02d246e9138", "name": "network-vif-plugged", "status": "completed", "tag": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924"}, {"server_uuid": "b190941d-9f62-41ef-881d-e02d246e9138", "name": "network-vif-plugged", "status": "completed", "tag": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:57:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-7c58e986-ede2-437f-b5ea-ec3e43d42248 req-11b4467d-616b-4080-9833-7c72180b7ca0 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-7c58e986-ede2-437f-b5ea-ec3e43d42248 req-11b4467d-616b-4080-9833-7c72180b7ca0 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-7c58e986-ede2-437f-b5ea-ec3e43d42248 req-11b4467d-616b-4080-9833-7c72180b7ca0 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:00 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-7c58e986-ede2-437f-b5ea-ec3e43d42248 req-11b4467d-616b-4080-9833-7c72180b7ca0 service nova] Creating event network-vif-plugged:37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance b190941d-9f62-41ef-881d-e02d246e9138 on user Apr 13 22:57:00 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-7c58e986-ede2-437f-b5ea-ec3e43d42248 req-11b4467d-616b-4080-9833-7c72180b7ca0 service nova] Creating event network-vif-plugged:37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance b190941d-9f62-41ef-881d-e02d246e9138 on user Apr 13 22:57:00 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-7c58e986-ede2-437f-b5ea-ec3e43d42248 req-11b4467d-616b-4080-9833-7c72180b7ca0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032373 Apr 13 22:57:00 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 81/240] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:57:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:57:01 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-8c62df06-099e-43b0-87f8-b1d47959b336 req-3d7516f5-a164-4376-a58d-e3dcebb563c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b32176-d23e-41cb-80b2-5e8eede9ba7f", "name": "network-vif-plugged", "status": "completed", "tag": "38a15311-5617-41cd-83a3-b253ee45f5d8"}, {"server_uuid": "74b32176-d23e-41cb-80b2-5e8eede9ba7f", "name": "network-vif-deleted", "tag": "38a15311-5617-41cd-83a3-b253ee45f5d8"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:57:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8c62df06-099e-43b0-87f8-b1d47959b336 req-3d7516f5-a164-4376-a58d-e3dcebb563c7 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8c62df06-099e-43b0-87f8-b1d47959b336 req-3d7516f5-a164-4376-a58d-e3dcebb563c7 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8c62df06-099e-43b0-87f8-b1d47959b336 req-3d7516f5-a164-4376-a58d-e3dcebb563c7 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:01 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-8c62df06-099e-43b0-87f8-b1d47959b336 req-3d7516f5-a164-4376-a58d-e3dcebb563c7 service nova] Creating event network-vif-plugged:38a15311-5617-41cd-83a3-b253ee45f5d8 for instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f on user Apr 13 22:57:01 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-8c62df06-099e-43b0-87f8-b1d47959b336 req-3d7516f5-a164-4376-a58d-e3dcebb563c7 service nova] Creating event network-vif-deleted:38a15311-5617-41cd-83a3-b253ee45f5d8 for instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f on user Apr 13 22:57:01 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-8c62df06-099e-43b0-87f8-b1d47959b336 req-3d7516f5-a164-4376-a58d-e3dcebb563c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062373 Apr 13 22:57:01 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 81/241] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:57:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:57:01 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1413427865", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "ca6e2122-7182-409a-ac67-4361de1d68a1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "aadb940e-808f-4d62-87fe-765d072b7c2f"}]}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:57:01 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:57:01 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] validate_networks() for [('aadb940e-808f-4d62-87fe-765d072b7c2f', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:57:02 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:57:02 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:57:02 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:57:02 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:57:02 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:57:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:02 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:57:02 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting quotas for project d872848d5dc1471996e2f33bbbdebbd9. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:57:02 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting quotas for user b289294050af4c41aeef8401832487a1 and project d872848d5dc1471996e2f33bbbdebbd9. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:57:02 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:57:02 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca6e2122-7182-409a-ac67-4361de1d68a1',volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:57:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.708950 Apr 13 22:57:02 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 80/242] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:57:01 2023] POST /compute/v2.1/servers => generated 378 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:57:02 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c4346566-9c3f-4388-bd07-67de69468b95 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:57:02 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-c4346566-9c3f-4388-bd07-67de69468b95 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:57:02 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:57:02 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-c4346566-9c3f-4388-bd07-67de69468b95 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:57:02 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-c4346566-9c3f-4388-bd07-67de69468b95 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6" status: 200 len: 1066 microversion: 2.1 time: 0.088128 Apr 13 22:57:02 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 82/243] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:57:02 2023] GET /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6 => generated 1066 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:57:05 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:57:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-5ec9fa3b-9b31-4162-931a-112a1953f002 req-c10aafe4-f90c-43bf-a06e-da010f17d9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c9ae9c-47df-41c7-8805-f6fe22bf09d6", "tag": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:57:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-5ec9fa3b-9b31-4162-931a-112a1953f002 req-c10aafe4-f90c-43bf-a06e-da010f17d9c0 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-5ec9fa3b-9b31-4162-931a-112a1953f002 req-c10aafe4-f90c-43bf-a06e-da010f17d9c0 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-5ec9fa3b-9b31-4162-931a-112a1953f002 req-c10aafe4-f90c-43bf-a06e-da010f17d9c0 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:05 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-5ec9fa3b-9b31-4162-931a-112a1953f002 req-c10aafe4-f90c-43bf-a06e-da010f17d9c0 service nova] Creating event network-changed:b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c for instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 on user Apr 13 22:57:05 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-5ec9fa3b-9b31-4162-931a-112a1953f002 req-c10aafe4-f90c-43bf-a06e-da010f17d9c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034362 Apr 13 22:57:05 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 82/244] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:57:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:57:11 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-c6ca3a12-3e06-474b-b41f-50a00fc902da req-4ecb8273-e6bf-4e88-973d-38c970830982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c9ae9c-47df-41c7-8805-f6fe22bf09d6", "name": "network-vif-plugged", "status": "completed", "tag": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:57:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c6ca3a12-3e06-474b-b41f-50a00fc902da req-4ecb8273-e6bf-4e88-973d-38c970830982 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c6ca3a12-3e06-474b-b41f-50a00fc902da req-4ecb8273-e6bf-4e88-973d-38c970830982 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c6ca3a12-3e06-474b-b41f-50a00fc902da req-4ecb8273-e6bf-4e88-973d-38c970830982 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:11 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-c6ca3a12-3e06-474b-b41f-50a00fc902da req-4ecb8273-e6bf-4e88-973d-38c970830982 service nova] Creating event network-vif-plugged:b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c for instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 on user Apr 13 22:57:11 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-c6ca3a12-3e06-474b-b41f-50a00fc902da req-4ecb8273-e6bf-4e88-973d-38c970830982 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052257 Apr 13 22:57:11 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 81/245] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:57:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:57:13 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-14704881-1a71-4912-aa79-9130cb455106 req-2d620a16-ffac-4c31-9962-da0cb3c63309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c9ae9c-47df-41c7-8805-f6fe22bf09d6", "name": "network-vif-plugged", "status": "completed", "tag": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:57:13 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:57:13 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=3 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:57:13 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:57:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-14704881-1a71-4912-aa79-9130cb455106 req-2d620a16-ffac-4c31-9962-da0cb3c63309 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-14704881-1a71-4912-aa79-9130cb455106 req-2d620a16-ffac-4c31-9962-da0cb3c63309 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-14704881-1a71-4912-aa79-9130cb455106 req-2d620a16-ffac-4c31-9962-da0cb3c63309 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:13 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-14704881-1a71-4912-aa79-9130cb455106 req-2d620a16-ffac-4c31-9962-da0cb3c63309 service nova] Creating event network-vif-plugged:b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c for instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 on user Apr 13 22:57:13 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-14704881-1a71-4912-aa79-9130cb455106 req-2d620a16-ffac-4c31-9962-da0cb3c63309 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033774 Apr 13 22:57:13 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 83/246] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:57:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:57:23 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-bb1b1f8f-b78d-47f3-9e5b-f9124644d7eb tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:57:23 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-bb1b1f8f-b78d-47f3-9e5b-f9124644d7eb tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:57:23 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=7 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:57:23 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:57:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bb1b1f8f-b78d-47f3-9e5b-f9124644d7eb tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bb1b1f8f-b78d-47f3-9e5b-f9124644d7eb tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bb1b1f8f-b78d-47f3-9e5b-f9124644d7eb tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bb1b1f8f-b78d-47f3-9e5b-f9124644d7eb tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bb1b1f8f-b78d-47f3-9e5b-f9124644d7eb tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bb1b1f8f-b78d-47f3-9e5b-f9124644d7eb tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:23 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-bb1b1f8f-b78d-47f3-9e5b-f9124644d7eb tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:57:23 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-bb1b1f8f-b78d-47f3-9e5b-f9124644d7eb tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:57:23 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-bb1b1f8f-b78d-47f3-9e5b-f9124644d7eb tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:57:23 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-bb1b1f8f-b78d-47f3-9e5b-f9124644d7eb tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7226cc11-4c2c-4a27-bb02-87ba1f749d33" status: 200 len: 1691 microversion: 2.87 time: 0.209784 Apr 13 22:57:23 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 83/247] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:57:23 2023] GET /compute/v2.1/servers/7226cc11-4c2c-4a27-bb02-87ba1f749d33 => generated 1691 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 22:57:29 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:57:29 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=12 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:57:29 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:57:29 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:57:29 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-37a521f9-6585-4d7a-80ce-be39bfc95c1a tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:57:29 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-37a521f9-6585-4d7a-80ce-be39bfc95c1a tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:57:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-37a521f9-6585-4d7a-80ce-be39bfc95c1a tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-37a521f9-6585-4d7a-80ce-be39bfc95c1a tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-37a521f9-6585-4d7a-80ce-be39bfc95c1a tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-37a521f9-6585-4d7a-80ce-be39bfc95c1a tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-37a521f9-6585-4d7a-80ce-be39bfc95c1a tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-37a521f9-6585-4d7a-80ce-be39bfc95c1a tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:29 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-37a521f9-6585-4d7a-80ce-be39bfc95c1a tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03ab225421441098f94350bef24442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd502d982f4fe424a8df8149962d46963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:57:29 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-37a521f9-6585-4d7a-80ce-be39bfc95c1a tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499" status: 200 len: 1701 microversion: 2.1 time: 0.367259 Apr 13 22:57:29 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 82/248] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:57:29 2023] GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499 => generated 1701 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:57:29 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:57:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-32ee7c0a-ddfd-4206-9d00-7dd64f08076d tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:57:30 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-32ee7c0a-ddfd-4206-9d00-7dd64f08076d tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:57:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-32ee7c0a-ddfd-4206-9d00-7dd64f08076d tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-32ee7c0a-ddfd-4206-9d00-7dd64f08076d tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-32ee7c0a-ddfd-4206-9d00-7dd64f08076d tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-32ee7c0a-ddfd-4206-9d00-7dd64f08076d tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-32ee7c0a-ddfd-4206-9d00-7dd64f08076d tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-32ee7c0a-ddfd-4206-9d00-7dd64f08076d tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:30 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-32ee7c0a-ddfd-4206-9d00-7dd64f08076d tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] HTTP exception thrown: Instance 3d246d08-7efe-4307-8a37-32f4c0621128 could not be found. Apr 13 22:57:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-32ee7c0a-ddfd-4206-9d00-7dd64f08076d tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Request method failure captured: Apr 13 22:57:30 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128 HTTP/1.1 Apr 13 22:57:30 user devstack@n-api.service[61611]: Accept: application/json Apr 13 22:57:30 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 22:57:30 user devstack@n-api.service[61611]: Connection: close Apr 13 22:57:30 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 22:57:30 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 22:57:30 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 22:57:30 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 22:57:30 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 22:57:30 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIfCB-hzXN_Mon1eVxyrlR6a5Ng4bVvjzi-Z0MhQIlYu0y7LNAZWn6mOa3TdHDjy0gUaAdIcgAJzrs9yGfUBs7WJ4UodfgxfAx994T8hz8QQA62O31KtI_Ni6n0xSeKln_k3aPy6rJQMHjgrFRHYo3AfDg-T9h1o1U-1Qqa0wxRVpRE Apr 13 22:57:30 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 22:57:30 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 22:57:30 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 22:57:30 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 22:57:30 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 22:57:30 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 22:57:30 user devstack@n-api.service[61611]: X-Project-Id: 3f871045289a43d18b339d3dac4d0666 Apr 13 22:57:30 user devstack@n-api.service[61611]: X-Project-Name: tempest-TestVolumeSwap-1308560563 Apr 13 22:57:30 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 22:57:30 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 22:57:30 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3f871045289a43d18b339d3dac4d0666"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f871045289a43d18b339d3dac4d0666"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f871045289a43d18b339d3dac4d0666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:57:30 user devstack@n-api.service[61611]: X-Tenant: tempest-TestVolumeSwap-1308560563 Apr 13 22:57:30 user devstack@n-api.service[61611]: X-Tenant-Id: 3f871045289a43d18b339d3dac4d0666 Apr 13 22:57:30 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-TestVolumeSwap-1308560563 Apr 13 22:57:30 user devstack@n-api.service[61611]: X-User: tempest-TestVolumeSwap-1308560563-project-member Apr 13 22:57:30 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 22:57:30 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 22:57:30 user devstack@n-api.service[61611]: X-User-Id: 20751f66f6564d04807dc09a675aef70 Apr 13 22:57:30 user devstack@n-api.service[61611]: X-User-Name: tempest-TestVolumeSwap-1308560563-project-member Apr 13 22:57:30 user devstack@n-api.service[61611]: method: > Apr 13 22:57:30 user devstack@n-api.service[61611]: exception: Instance 3d246d08-7efe-4307-8a37-32f4c0621128 could not be found. Apr 13 22:57:30 user devstack@n-api.service[61611]: action_args: {'id': '3d246d08-7efe-4307-8a37-32f4c0621128'} Apr 13 22:57:30 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d246d08-7efe-4307-8a37-32f4c0621128 could not be found. Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d246d08-7efe-4307-8a37-32f4c0621128 could not be found. Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d246d08-7efe-4307-8a37-32f4c0621128 could not be found. Apr 13 22:57:30 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:57:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-32ee7c0a-ddfd-4206-9d00-7dd64f08076d tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Returning 404 to user: Instance 3d246d08-7efe-4307-8a37-32f4c0621128 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:57:30 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-32ee7c0a-ddfd-4206-9d00-7dd64f08076d tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128" status: 404 len: 111 microversion: 2.1 time: 0.042670 Apr 13 22:57:30 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 84/249] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:57:29 2023] GET /compute/v2.1/servers/3d246d08-7efe-4307-8a37-32f4c0621128 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:57:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-cecc028f-34a1-4850-9fa9-00df5a265f04 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Calling method '.version_select at 0x7f3d1de76cb0>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:57:30 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-cecc028f-34a1-4850-9fa9-00df5a265f04 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139033731" status: 202 len: 0 microversion: 2.1 time: 0.032127 Apr 13 22:57:30 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 84/250] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 22:57:30 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139033731 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:57:40 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-382b9155-fb29-4426-b848-6783953b8479 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:57:40 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-382b9155-fb29-4426-b848-6783953b8479 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:57:40 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:57:40 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:57:40 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-382b9155-fb29-4426-b848-6783953b8479 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:40 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-382b9155-fb29-4426-b848-6783953b8479 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:40 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-382b9155-fb29-4426-b848-6783953b8479 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:40 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-382b9155-fb29-4426-b848-6783953b8479 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:40 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-382b9155-fb29-4426-b848-6783953b8479 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:40 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-382b9155-fb29-4426-b848-6783953b8479 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:40 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-382b9155-fb29-4426-b848-6783953b8479 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b46af525dd45678b69207e93683ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0648ea953174a8cae6085ac24d92bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:57:40 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-382b9155-fb29-4426-b848-6783953b8479 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b" status: 200 len: 1698 microversion: 2.1 time: 0.180277 Apr 13 22:57:40 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 83/251] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:57:40 2023] GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b => generated 1698 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:57:42 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:57:42 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:57:42 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:57:42 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:57:42 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:42 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:42 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:42 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:42 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:42 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:42 user devstack@n-api.service[61611]: DEBUG nova.objects.instance [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'flavor' on Instance uuid df12dd8d-ea02-4c59-804d-52ae1bd4a555 {{(pid=61611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:57:42 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "POST /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555/action" status: 200 len: 32 microversion: 2.1 time: 0.151496 Apr 13 22:57:42 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 85/252] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 22:57:42 2023] POST /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 22:57:42 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:57:42 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:57:42 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-dd38f02d-f940-4c66-9f97-f6182e14ce3f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:57:42 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-dd38f02d-f940-4c66-9f97-f6182e14ce3f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:57:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-dd38f02d-f940-4c66-9f97-f6182e14ce3f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-dd38f02d-f940-4c66-9f97-f6182e14ce3f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-dd38f02d-f940-4c66-9f97-f6182e14ce3f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-dd38f02d-f940-4c66-9f97-f6182e14ce3f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-dd38f02d-f940-4c66-9f97-f6182e14ce3f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-dd38f02d-f940-4c66-9f97-f6182e14ce3f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:43 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-dd38f02d-f940-4c66-9f97-f6182e14ce3f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:57:43 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-dd38f02d-f940-4c66-9f97-f6182e14ce3f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555" status: 200 len: 1511 microversion: 2.1 time: 0.209631 Apr 13 22:57:43 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 85/253] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:57:42 2023] GET /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555 => generated 1511 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:57:43 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-98f788f8-3c8e-4ccf-9dfd-57e10a4b4318 req-bd478382-e0f5-43ca-aed9-cf56521027cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df12dd8d-ea02-4c59-804d-52ae1bd4a555", "name": "network-vif-unplugged", "status": "completed", "tag": "6566345e-be68-4eb1-90de-e53780e7f8f9"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:57:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-98f788f8-3c8e-4ccf-9dfd-57e10a4b4318 req-bd478382-e0f5-43ca-aed9-cf56521027cc service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-98f788f8-3c8e-4ccf-9dfd-57e10a4b4318 req-bd478382-e0f5-43ca-aed9-cf56521027cc service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-98f788f8-3c8e-4ccf-9dfd-57e10a4b4318 req-bd478382-e0f5-43ca-aed9-cf56521027cc service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:43 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-98f788f8-3c8e-4ccf-9dfd-57e10a4b4318 req-bd478382-e0f5-43ca-aed9-cf56521027cc service nova] Creating event network-vif-unplugged:6566345e-be68-4eb1-90de-e53780e7f8f9 for instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 on user Apr 13 22:57:43 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-98f788f8-3c8e-4ccf-9dfd-57e10a4b4318 req-bd478382-e0f5-43ca-aed9-cf56521027cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035084 Apr 13 22:57:43 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 84/254] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:57:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:57:43 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-fb6df42d-071e-4bbb-a55e-a41e07912d1d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:57:43 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-fb6df42d-071e-4bbb-a55e-a41e07912d1d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:57:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-fb6df42d-071e-4bbb-a55e-a41e07912d1d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-fb6df42d-071e-4bbb-a55e-a41e07912d1d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-fb6df42d-071e-4bbb-a55e-a41e07912d1d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-fb6df42d-071e-4bbb-a55e-a41e07912d1d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-fb6df42d-071e-4bbb-a55e-a41e07912d1d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-fb6df42d-071e-4bbb-a55e-a41e07912d1d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:44 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-fb6df42d-071e-4bbb-a55e-a41e07912d1d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:57:44 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-fb6df42d-071e-4bbb-a55e-a41e07912d1d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138" status: 200 len: 1537 microversion: 2.1 time: 0.255616 Apr 13 22:57:44 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 86/255] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:57:43 2023] GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138 => generated 1537 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:57:45 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-fe05854d-9159-4ac5-9ca4-c7addb175bbb req-9da27258-2a2e-4d41-8c37-24c1bc6fd3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df12dd8d-ea02-4c59-804d-52ae1bd4a555", "name": "network-vif-plugged", "status": "completed", "tag": "6566345e-be68-4eb1-90de-e53780e7f8f9"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:57:45 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-fe05854d-9159-4ac5-9ca4-c7addb175bbb req-9da27258-2a2e-4d41-8c37-24c1bc6fd3c9 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:45 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-fe05854d-9159-4ac5-9ca4-c7addb175bbb req-9da27258-2a2e-4d41-8c37-24c1bc6fd3c9 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:45 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-fe05854d-9159-4ac5-9ca4-c7addb175bbb req-9da27258-2a2e-4d41-8c37-24c1bc6fd3c9 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:45 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-fe05854d-9159-4ac5-9ca4-c7addb175bbb req-9da27258-2a2e-4d41-8c37-24c1bc6fd3c9 service nova] Creating event network-vif-plugged:6566345e-be68-4eb1-90de-e53780e7f8f9 for instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 on user Apr 13 22:57:45 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-fe05854d-9159-4ac5-9ca4-c7addb175bbb req-9da27258-2a2e-4d41-8c37-24c1bc6fd3c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030428 Apr 13 22:57:45 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 86/256] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:57:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:57:47 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-4130c6f4-24c6-45ae-a809-1d3eacf1e05c req-e594d779-e59d-49d2-9876-5f1b36d68dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df12dd8d-ea02-4c59-804d-52ae1bd4a555", "name": "network-vif-plugged", "status": "completed", "tag": "6566345e-be68-4eb1-90de-e53780e7f8f9"}, {"server_uuid": "df12dd8d-ea02-4c59-804d-52ae1bd4a555", "name": "network-vif-plugged", "status": "completed", "tag": "6566345e-be68-4eb1-90de-e53780e7f8f9"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:57:47 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-4130c6f4-24c6-45ae-a809-1d3eacf1e05c req-e594d779-e59d-49d2-9876-5f1b36d68dd9 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:47 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-4130c6f4-24c6-45ae-a809-1d3eacf1e05c req-e594d779-e59d-49d2-9876-5f1b36d68dd9 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:47 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-4130c6f4-24c6-45ae-a809-1d3eacf1e05c req-e594d779-e59d-49d2-9876-5f1b36d68dd9 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:47 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-4130c6f4-24c6-45ae-a809-1d3eacf1e05c req-e594d779-e59d-49d2-9876-5f1b36d68dd9 service nova] Creating event network-vif-plugged:6566345e-be68-4eb1-90de-e53780e7f8f9 for instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 on user Apr 13 22:57:47 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-4130c6f4-24c6-45ae-a809-1d3eacf1e05c req-e594d779-e59d-49d2-9876-5f1b36d68dd9 service nova] Creating event network-vif-plugged:6566345e-be68-4eb1-90de-e53780e7f8f9 for instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 on user Apr 13 22:57:47 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-4130c6f4-24c6-45ae-a809-1d3eacf1e05c req-e594d779-e59d-49d2-9876-5f1b36d68dd9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033513 Apr 13 22:57:47 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 85/257] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:57:47 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:57:49 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-9f3e505a-92d3-4186-a833-ac76eed6e224 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:57:49 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-9f3e505a-92d3-4186-a833-ac76eed6e224 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:57:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9f3e505a-92d3-4186-a833-ac76eed6e224 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9f3e505a-92d3-4186-a833-ac76eed6e224 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9f3e505a-92d3-4186-a833-ac76eed6e224 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9f3e505a-92d3-4186-a833-ac76eed6e224 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9f3e505a-92d3-4186-a833-ac76eed6e224 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9f3e505a-92d3-4186-a833-ac76eed6e224 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:49 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-9f3e505a-92d3-4186-a833-ac76eed6e224 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] HTTP exception thrown: Instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f could not be found. Apr 13 22:57:49 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-9f3e505a-92d3-4186-a833-ac76eed6e224 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Request method failure captured: Apr 13 22:57:49 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f HTTP/1.1 Apr 13 22:57:49 user devstack@n-api.service[61611]: Accept: application/json Apr 13 22:57:49 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 22:57:49 user devstack@n-api.service[61611]: Connection: close Apr 13 22:57:49 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 22:57:49 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 22:57:49 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 22:57:49 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 22:57:49 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 22:57:49 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIfFTd-GGuNLZhpg908qNRAUWwxNgAfeCUimfaNa0b2DAb_GHBW4t-lVsJou0tz2or0f6bqUrzjLpozKP8y8w6AYyySvjwkcbo4hPrDnlFVSF3sjpEAKCireroRzn4mK7Mj_j8ZmmwDUGWxo3vQ2pAQyz117nhwbP810jFnZYlkUbLs Apr 13 22:57:49 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 22:57:49 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 22:57:49 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 22:57:49 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 22:57:49 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 22:57:49 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 22:57:49 user devstack@n-api.service[61611]: X-Project-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 22:57:49 user devstack@n-api.service[61611]: X-Project-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 22:57:49 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 22:57:49 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 22:57:49 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:57:49 user devstack@n-api.service[61611]: X-Tenant: tempest-AttachVolumeNegativeTest-704876090 Apr 13 22:57:49 user devstack@n-api.service[61611]: X-Tenant-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 22:57:49 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 22:57:49 user devstack@n-api.service[61611]: X-User: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 22:57:49 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 22:57:49 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 22:57:49 user devstack@n-api.service[61611]: X-User-Id: 98594f3f6ccf4ffdbfd91bcf192d936e Apr 13 22:57:49 user devstack@n-api.service[61611]: X-User-Name: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 22:57:49 user devstack@n-api.service[61611]: method: > Apr 13 22:57:49 user devstack@n-api.service[61611]: exception: Instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f could not be found. Apr 13 22:57:49 user devstack@n-api.service[61611]: action_args: {'id': '74b32176-d23e-41cb-80b2-5e8eede9ba7f'} Apr 13 22:57:49 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f could not be found. Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f could not be found. Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f could not be found. Apr 13 22:57:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:57:49 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-9f3e505a-92d3-4186-a833-ac76eed6e224 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Returning 404 to user: Instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:57:49 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-9f3e505a-92d3-4186-a833-ac76eed6e224 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f" status: 404 len: 111 microversion: 2.1 time: 0.030996 Apr 13 22:57:49 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 87/258] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:57:49 2023] GET /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:57:49 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-7cc177cf-22fe-4d47-a840-14bc2c2ab386 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '.version_select at 0x7f3d1df86d40>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:57:49 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-7cc177cf-22fe-4d47-a840-14bc2c2ab386 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770675987" status: 202 len: 0 microversion: 2.1 time: 0.027354 Apr 13 22:57:49 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 87/259] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 22:57:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770675987 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:57:50 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:57:50 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:57:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:50 user devstack@n-api.service[61612]: DEBUG nova.objects.instance [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'services' on Instance uuid 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 {{(pid=61612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:57:50 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/os-volume_attachments/098aedca-2822-4384-bff5-58cccb0f96a0" status: 202 len: 0 microversion: 2.1 time: 0.225010 Apr 13 22:57:50 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 86/260] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 22:57:50 2023] DELETE /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/os-volume_attachments/098aedca-2822-4384-bff5-58cccb0f96a0 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:57:50 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f0491def-689f-4571-89c4-e3758c2e7d9e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:57:50 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f0491def-689f-4571-89c4-e3758c2e7d9e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:57:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0491def-689f-4571-89c4-e3758c2e7d9e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0491def-689f-4571-89c4-e3758c2e7d9e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0491def-689f-4571-89c4-e3758c2e7d9e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0491def-689f-4571-89c4-e3758c2e7d9e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0491def-689f-4571-89c4-e3758c2e7d9e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0491def-689f-4571-89c4-e3758c2e7d9e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:50 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f0491def-689f-4571-89c4-e3758c2e7d9e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058332 Apr 13 22:57:50 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 88/261] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:57:50 2023] GET /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:57:52 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-fc493111-b669-4bb0-88a8-52fd3bab20a9 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:57:52 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-fc493111-b669-4bb0-88a8-52fd3bab20a9 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:57:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fc493111-b669-4bb0-88a8-52fd3bab20a9 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fc493111-b669-4bb0-88a8-52fd3bab20a9 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fc493111-b669-4bb0-88a8-52fd3bab20a9 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fc493111-b669-4bb0-88a8-52fd3bab20a9 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:57:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fc493111-b669-4bb0-88a8-52fd3bab20a9 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:57:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fc493111-b669-4bb0-88a8-52fd3bab20a9 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:57:52 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-fc493111-b669-4bb0-88a8-52fd3bab20a9 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:57:52 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-fc493111-b669-4bb0-88a8-52fd3bab20a9 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6" status: 200 len: 1393 microversion: 2.1 time: 0.168805 Apr 13 22:57:52 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 88/262] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:57:52 2023] GET /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:58:00 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=8 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:58:00 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-36bae4c7-5fb8-4cd6-a546-83e9aeacd6ba tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "605654e5-ee84-4f26-93bb-937e7c54ea20"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:00 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-36bae4c7-5fb8-4cd6-a546-83e9aeacd6ba tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-36bae4c7-5fb8-4cd6-a546-83e9aeacd6ba tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-36bae4c7-5fb8-4cd6-a546-83e9aeacd6ba tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-36bae4c7-5fb8-4cd6-a546-83e9aeacd6ba tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-36bae4c7-5fb8-4cd6-a546-83e9aeacd6ba tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-36bae4c7-5fb8-4cd6-a546-83e9aeacd6ba tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-36bae4c7-5fb8-4cd6-a546-83e9aeacd6ba tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:00 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-36bae4c7-5fb8-4cd6-a546-83e9aeacd6ba tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] HTTP exception thrown: Volume 83b5d3dd-6190-49aa-a7a7-962fba1d034f could not be found. Apr 13 22:58:00 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-36bae4c7-5fb8-4cd6-a546-83e9aeacd6ba tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] Request method failure captured: Apr 13 22:58:00 user devstack@n-api.service[61612]: request: PUT /compute/v2.1/servers/c10b97ca-3231-41fe-9de5-03cd6dc81e07/os-volume_attachments/83b5d3dd-6190-49aa-a7a7-962fba1d034f HTTP/1.1 Apr 13 22:58:00 user devstack@n-api.service[61612]: Accept: application/json Apr 13 22:58:00 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 22:58:00 user devstack@n-api.service[61612]: Connection: close Apr 13 22:58:00 user devstack@n-api.service[61612]: Content-Length: 74 Apr 13 22:58:00 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 22:58:00 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 22:58:00 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 22:58:00 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 22:58:00 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIfSrXxqjNr5UNoxCuYx53Eo4OECpMlqMbV0ggoe9hj7pyKdR2NhDesZzTnKzvxLwqN9t6O10VkhTLBYbtcO1wRzoEEtwGnJcmi5rnGG_U-QBbG083mFgoZYZYGO6PemhifPaKmCIp8Zfqc89Y3LhoeCjW6OghbeQVIwfvoAQTBM6wM Apr 13 22:58:00 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 22:58:00 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 22:58:00 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 22:58:00 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 22:58:00 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 22:58:00 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 22:58:00 user devstack@n-api.service[61612]: X-Project-Id: cb0978418e294095bfad58844e218d4f Apr 13 22:58:00 user devstack@n-api.service[61612]: X-Project-Name: tempest-VolumesAdminNegativeTest-750754475 Apr 13 22:58:00 user devstack@n-api.service[61612]: X-Role: member,admin,reader Apr 13 22:58:00 user devstack@n-api.service[61612]: X-Roles: member,admin,reader Apr 13 22:58:00 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb0978418e294095bfad58844e218d4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0978418e294095bfad58844e218d4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0978418e294095bfad58844e218d4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:58:00 user devstack@n-api.service[61612]: X-Tenant: tempest-VolumesAdminNegativeTest-750754475 Apr 13 22:58:00 user devstack@n-api.service[61612]: X-Tenant-Id: cb0978418e294095bfad58844e218d4f Apr 13 22:58:00 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-750754475 Apr 13 22:58:00 user devstack@n-api.service[61612]: X-User: tempest-VolumesAdminNegativeTest-750754475-project-admin Apr 13 22:58:00 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 22:58:00 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 22:58:00 user devstack@n-api.service[61612]: X-User-Id: 20a21aae018f47129a7a263cac57e0da Apr 13 22:58:00 user devstack@n-api.service[61612]: X-User-Name: tempest-VolumesAdminNegativeTest-750754475-project-admin Apr 13 22:58:00 user devstack@n-api.service[61612]: Apr 13 22:58:00 user devstack@n-api.service[61612]: {"volumeAttachment": {"volumeId": "605654e5-ee84-4f26-93bb-937e7c54ea20"}} Apr 13 22:58:00 user devstack@n-api.service[61612]: method: > Apr 13 22:58:00 user devstack@n-api.service[61612]: exception: Volume 83b5d3dd-6190-49aa-a7a7-962fba1d034f could not be found. Apr 13 22:58:00 user devstack@n-api.service[61612]: action_args: {'server_id': 'c10b97ca-3231-41fe-9de5-03cd6dc81e07', 'id': '83b5d3dd-6190-49aa-a7a7-962fba1d034f', 'body': {'volumeAttachment': {'volumeId': '605654e5-ee84-4f26-93bb-937e7c54ea20'}}} Apr 13 22:58:00 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 83b5d3dd-6190-49aa-a7a7-962fba1d034f could not be found. (HTTP 404) (Request-ID: req-bd194ad9-8dbc-4f9c-b13b-3203b69d91c5) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 83b5d3dd-6190-49aa-a7a7-962fba1d034f could not be found. Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 83b5d3dd-6190-49aa-a7a7-962fba1d034f could not be found. Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 83b5d3dd-6190-49aa-a7a7-962fba1d034f could not be found. Apr 13 22:58:00 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:58:00 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-36bae4c7-5fb8-4cd6-a546-83e9aeacd6ba tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] Returning 404 to user: Volume 83b5d3dd-6190-49aa-a7a7-962fba1d034f could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:58:00 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-36bae4c7-5fb8-4cd6-a546-83e9aeacd6ba tempest-VolumesAdminNegativeTest-750754475 tempest-VolumesAdminNegativeTest-750754475-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/c10b97ca-3231-41fe-9de5-03cd6dc81e07/os-volume_attachments/83b5d3dd-6190-49aa-a7a7-962fba1d034f" status: 404 len: 109 microversion: 2.1 time: 0.122504 Apr 13 22:58:00 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 87/263] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 22:58:00 2023] PUT /compute/v2.1/servers/c10b97ca-3231-41fe-9de5-03cd6dc81e07/os-volume_attachments/83b5d3dd-6190-49aa-a7a7-962fba1d034f => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:58:03 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b3889395-cb9b-4d80-adfc-eac127d9f8b0 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Action: 'create', calling method: .version_select at 0x7f3d1e0bfd90>, body: {"keypair": {"name": "tempest-keypair-47503195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsBCUK/d98kWpmMU9GtCOu6nr5CDGTtBtm+Xn++wGM4jnm2DyWRjyEh/+NCLMld7/6IKE1/2NukPOJeyCzBwV0Jvso0KIu7787dA73p5k6nI2cKkPoTqObx/zAdZPPwgg=="}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:03 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=8 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:58:03 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:58:03 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-b3889395-cb9b-4d80-adfc-eac127d9f8b0 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Getting quotas for project f8b1ce9b9f4d4adf8316110aae9e04d7. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:58:03 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-b3889395-cb9b-4d80-adfc-eac127d9f8b0 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Getting quotas for user 9ec0b2d09be54070ab00037165788f8a and project f8b1ce9b9f4d4adf8316110aae9e04d7. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:58:03 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-b3889395-cb9b-4d80-adfc-eac127d9f8b0 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.49 time: 0.062442 Apr 13 22:58:03 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 89/264] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 22:58:03 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 64 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 22:58:03 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:03 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:03 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:58:03 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=14 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:58:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:03 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:58:04 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c10b97ca-3231-41fe-9de5-03cd6dc81e07" status: 204 len: 0 microversion: 2.1 time: 0.178812 Apr 13 22:58:04 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 89/265] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:58:03 2023] DELETE /compute/v2.1/servers/c10b97ca-3231-41fe-9de5-03cd6dc81e07 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:58:04 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-4137f422-c77a-4898-b57a-c3ea3b34620d tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:04 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-4137f422-c77a-4898-b57a-c3ea3b34620d tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4137f422-c77a-4898-b57a-c3ea3b34620d tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4137f422-c77a-4898-b57a-c3ea3b34620d tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4137f422-c77a-4898-b57a-c3ea3b34620d tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4137f422-c77a-4898-b57a-c3ea3b34620d tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4137f422-c77a-4898-b57a-c3ea3b34620d tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4137f422-c77a-4898-b57a-c3ea3b34620d tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:04 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-4137f422-c77a-4898-b57a-c3ea3b34620d tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b08dea04784bc3b07195f951a84bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33cf3bf67714b0ba9c7f703a1c9e5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:58:04 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-4137f422-c77a-4898-b57a-c3ea3b34620d tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c10b97ca-3231-41fe-9de5-03cd6dc81e07" status: 200 len: 1501 microversion: 2.1 time: 0.205732 Apr 13 22:58:04 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 88/266] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:58:04 2023] GET /compute/v2.1/servers/c10b97ca-3231-41fe-9de5-03cd6dc81e07 => generated 1501 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:58:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-9d1b932c-b968-4d1c-929c-501c6a8d1107 req-9a03d4b7-128b-4f12-be2c-9bbfb4fc651a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10b97ca-3231-41fe-9de5-03cd6dc81e07", "name": "network-vif-unplugged", "status": "completed", "tag": "d8c122f3-f485-406e-87b1-c547eabd5bf3"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9d1b932c-b968-4d1c-929c-501c6a8d1107 req-9a03d4b7-128b-4f12-be2c-9bbfb4fc651a service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9d1b932c-b968-4d1c-929c-501c6a8d1107 req-9a03d4b7-128b-4f12-be2c-9bbfb4fc651a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9d1b932c-b968-4d1c-929c-501c6a8d1107 req-9a03d4b7-128b-4f12-be2c-9bbfb4fc651a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:04 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-9d1b932c-b968-4d1c-929c-501c6a8d1107 req-9a03d4b7-128b-4f12-be2c-9bbfb4fc651a service nova] Creating event network-vif-unplugged:d8c122f3-f485-406e-87b1-c547eabd5bf3 for instance c10b97ca-3231-41fe-9de5-03cd6dc81e07 on user Apr 13 22:58:04 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-9d1b932c-b968-4d1c-929c-501c6a8d1107 req-9a03d4b7-128b-4f12-be2c-9bbfb4fc651a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.158166 Apr 13 22:58:04 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 90/267] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:58:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:58:06 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-dad0d764-4472-489c-94df-962bafb3722f req-333a9dff-ee4c-482b-af0a-dbf6130184fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10b97ca-3231-41fe-9de5-03cd6dc81e07", "name": "network-vif-deleted", "tag": "d8c122f3-f485-406e-87b1-c547eabd5bf3"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-dad0d764-4472-489c-94df-962bafb3722f req-333a9dff-ee4c-482b-af0a-dbf6130184fe service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-dad0d764-4472-489c-94df-962bafb3722f req-333a9dff-ee4c-482b-af0a-dbf6130184fe service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-dad0d764-4472-489c-94df-962bafb3722f req-333a9dff-ee4c-482b-af0a-dbf6130184fe service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-dad0d764-4472-489c-94df-962bafb3722f req-333a9dff-ee4c-482b-af0a-dbf6130184fe service nova] Creating event network-vif-deleted:d8c122f3-f485-406e-87b1-c547eabd5bf3 for instance c10b97ca-3231-41fe-9de5-03cd6dc81e07 on user Apr 13 22:58:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-dad0d764-4472-489c-94df-962bafb3722f req-333a9dff-ee4c-482b-af0a-dbf6130184fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096682 Apr 13 22:58:06 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 90/268] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:58:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:58:06 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-320023131", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "da27b21f-936f-44bf-84a4-2ea0dbd38456"}], "security_groups": [{"name": "tempest-securitygroup--1433327912"}], "key_name": "tempest-keypair-47503195", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:06 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] validate_networks() for [('da27b21f-936f-44bf-84a4-2ea0dbd38456', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:58:06 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10b97ca-3231-41fe-9de5-03cd6dc81e07", "name": "network-vif-plugged", "status": "completed", "tag": "d8c122f3-f485-406e-87b1-c547eabd5bf3"}, {"server_uuid": "c10b97ca-3231-41fe-9de5-03cd6dc81e07", "name": "network-vif-plugged", "status": "completed", "tag": "d8c122f3-f485-406e-87b1-c547eabd5bf3"}, {"server_uuid": "c10b97ca-3231-41fe-9de5-03cd6dc81e07", "name": "network-vif-plugged", "status": "completed", "tag": "d8c122f3-f485-406e-87b1-c547eabd5bf3"}, {"server_uuid": "c10b97ca-3231-41fe-9de5-03cd6dc81e07", "name": "network-vif-unplugged", "status": "completed", "tag": "d8c122f3-f485-406e-87b1-c547eabd5bf3"}, {"server_uuid": "c10b97ca-3231-41fe-9de5-03cd6dc81e07", "name": "network-vif-plugged", "status": "completed", "tag": "d8c122f3-f485-406e-87b1-c547eabd5bf3"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:06 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Creating event network-vif-plugged:d8c122f3-f485-406e-87b1-c547eabd5bf3 for instance c10b97ca-3231-41fe-9de5-03cd6dc81e07 on user Apr 13 22:58:06 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Creating event network-vif-plugged:d8c122f3-f485-406e-87b1-c547eabd5bf3 for instance c10b97ca-3231-41fe-9de5-03cd6dc81e07 on user Apr 13 22:58:06 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Creating event network-vif-plugged:d8c122f3-f485-406e-87b1-c547eabd5bf3 for instance c10b97ca-3231-41fe-9de5-03cd6dc81e07 on user Apr 13 22:58:06 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Creating event network-vif-unplugged:d8c122f3-f485-406e-87b1-c547eabd5bf3 for instance c10b97ca-3231-41fe-9de5-03cd6dc81e07 on user Apr 13 22:58:06 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Creating event network-vif-plugged:d8c122f3-f485-406e-87b1-c547eabd5bf3 for instance c10b97ca-3231-41fe-9de5-03cd6dc81e07 on user Apr 13 22:58:06 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.081055 Apr 13 22:58:06 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 91/269] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:58:06 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:58:06 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:58:06 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:58:06 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:58:06 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:58:06 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:58:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:06 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Getting quotas for project f8b1ce9b9f4d4adf8316110aae9e04d7. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:58:06 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Getting quotas for user 9ec0b2d09be54070ab00037165788f8a and project f8b1ce9b9f4d4adf8316110aae9e04d7. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:58:06 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:58:06 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:58:06 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 0.637363 Apr 13 22:58:06 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 89/270] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 22:58:06 2023] POST /compute/v2.1/servers => generated 404 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 22:58:06 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-54d87c8e-a7ad-4ec6-9e78-4aa1ccacd6a1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:06 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-54d87c8e-a7ad-4ec6-9e78-4aa1ccacd6a1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:06 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-54d87c8e-a7ad-4ec6-9e78-4aa1ccacd6a1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec0b2d09be54070ab00037165788f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b1ce9b9f4d4adf8316110aae9e04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:58:06 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-54d87c8e-a7ad-4ec6-9e78-4aa1ccacd6a1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ec0b2d09be54070ab00037165788f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b1ce9b9f4d4adf8316110aae9e04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:58:06 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-54d87c8e-a7ad-4ec6-9e78-4aa1ccacd6a1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ec0b2d09be54070ab00037165788f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b1ce9b9f4d4adf8316110aae9e04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:58:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-54d87c8e-a7ad-4ec6-9e78-4aa1ccacd6a1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a" status: 200 len: 1318 microversion: 2.49 time: 0.118542 Apr 13 22:58:06 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 91/271] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:58:06 2023] GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a => generated 1318 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 22:58:09 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-1d2316b7-b194-4cb0-b4b9-f5b94828a7cc req-a5dc3474-8230-4e37-8c9a-5f4dbe0e2fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f6a020c-d8b5-4f6b-a3f0-38287111153a", "tag": "ffc806fb-1b25-492f-b786-27222f795160"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-1d2316b7-b194-4cb0-b4b9-f5b94828a7cc req-a5dc3474-8230-4e37-8c9a-5f4dbe0e2fab service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-1d2316b7-b194-4cb0-b4b9-f5b94828a7cc req-a5dc3474-8230-4e37-8c9a-5f4dbe0e2fab service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-1d2316b7-b194-4cb0-b4b9-f5b94828a7cc req-a5dc3474-8230-4e37-8c9a-5f4dbe0e2fab service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:09 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-1d2316b7-b194-4cb0-b4b9-f5b94828a7cc req-a5dc3474-8230-4e37-8c9a-5f4dbe0e2fab service nova] Creating event network-changed:ffc806fb-1b25-492f-b786-27222f795160 for instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a on user Apr 13 22:58:09 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-1d2316b7-b194-4cb0-b4b9-f5b94828a7cc req-a5dc3474-8230-4e37-8c9a-5f4dbe0e2fab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031906 Apr 13 22:58:09 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 92/272] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:58:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:58:11 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-867bce98-16e6-4e34-a3c9-d83089c64ad5 req-efdc9d49-8bee-4535-b6a8-4fc879d4e35b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6a020c-d8b5-4f6b-a3f0-38287111153a", "name": "network-vif-plugged", "status": "completed", "tag": "ffc806fb-1b25-492f-b786-27222f795160"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-867bce98-16e6-4e34-a3c9-d83089c64ad5 req-efdc9d49-8bee-4535-b6a8-4fc879d4e35b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-867bce98-16e6-4e34-a3c9-d83089c64ad5 req-efdc9d49-8bee-4535-b6a8-4fc879d4e35b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-867bce98-16e6-4e34-a3c9-d83089c64ad5 req-efdc9d49-8bee-4535-b6a8-4fc879d4e35b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:11 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=32,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:58:11 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-867bce98-16e6-4e34-a3c9-d83089c64ad5 req-efdc9d49-8bee-4535-b6a8-4fc879d4e35b service nova] Creating event network-vif-plugged:ffc806fb-1b25-492f-b786-27222f795160 for instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a on user Apr 13 22:58:11 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-867bce98-16e6-4e34-a3c9-d83089c64ad5 req-efdc9d49-8bee-4535-b6a8-4fc879d4e35b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030475 Apr 13 22:58:11 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 90/273] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:58:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:58:13 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-0ad8833b-c221-47b7-8fcc-de5028a877b8 req-9ac21357-0d44-41d9-8588-4f8da7ce3c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6a020c-d8b5-4f6b-a3f0-38287111153a", "name": "network-vif-plugged", "status": "completed", "tag": "ffc806fb-1b25-492f-b786-27222f795160"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0ad8833b-c221-47b7-8fcc-de5028a877b8 req-9ac21357-0d44-41d9-8588-4f8da7ce3c47 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0ad8833b-c221-47b7-8fcc-de5028a877b8 req-9ac21357-0d44-41d9-8588-4f8da7ce3c47 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0ad8833b-c221-47b7-8fcc-de5028a877b8 req-9ac21357-0d44-41d9-8588-4f8da7ce3c47 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:13 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-0ad8833b-c221-47b7-8fcc-de5028a877b8 req-9ac21357-0d44-41d9-8588-4f8da7ce3c47 service nova] Creating event network-vif-plugged:ffc806fb-1b25-492f-b786-27222f795160 for instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a on user Apr 13 22:58:13 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-0ad8833b-c221-47b7-8fcc-de5028a877b8 req-9ac21357-0d44-41d9-8588-4f8da7ce3c47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035480 Apr 13 22:58:13 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 92/274] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:58:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:58:23 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:58:23 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:58:23 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:58:23 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-330782968"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:23 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:24 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7226cc11-4c2c-4a27-bb02-87ba1f749d33/action" status: 202 len: 52 microversion: 2.87 time: 0.817014 Apr 13 22:58:24 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 93/275] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 22:58:23 2023] POST /compute/v2.1/servers/7226cc11-4c2c-4a27-bb02-87ba1f749d33/action => generated 52 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 13 22:58:29 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:58:29 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:58:29 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:58:29 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:58:29 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-3bbc7189-dd47-4e7c-82f8-0145de798e75 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:29 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-3bbc7189-dd47-4e7c-82f8-0145de798e75 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3bbc7189-dd47-4e7c-82f8-0145de798e75 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3bbc7189-dd47-4e7c-82f8-0145de798e75 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3bbc7189-dd47-4e7c-82f8-0145de798e75 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3bbc7189-dd47-4e7c-82f8-0145de798e75 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3bbc7189-dd47-4e7c-82f8-0145de798e75 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3bbc7189-dd47-4e7c-82f8-0145de798e75 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:29 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-3bbc7189-dd47-4e7c-82f8-0145de798e75 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:58:29 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-3bbc7189-dd47-4e7c-82f8-0145de798e75 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:58:29 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-3bbc7189-dd47-4e7c-82f8-0145de798e75 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:58:29 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-3bbc7189-dd47-4e7c-82f8-0145de798e75 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7226cc11-4c2c-4a27-bb02-87ba1f749d33" status: 200 len: 1691 microversion: 2.87 time: 0.196884 Apr 13 22:58:29 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 91/276] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:58:29 2023] GET /compute/v2.1/servers/7226cc11-4c2c-4a27-bb02-87ba1f749d33 => generated 1691 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 22:58:30 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:58:30 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:58:30 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:58:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-ed304229-e52b-447a-95af-9bd29697781c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:30 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-ed304229-e52b-447a-95af-9bd29697781c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ed304229-e52b-447a-95af-9bd29697781c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ed304229-e52b-447a-95af-9bd29697781c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ed304229-e52b-447a-95af-9bd29697781c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ed304229-e52b-447a-95af-9bd29697781c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ed304229-e52b-447a-95af-9bd29697781c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ed304229-e52b-447a-95af-9bd29697781c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:30 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-ed304229-e52b-447a-95af-9bd29697781c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499/action" status: 202 len: 0 microversion: 2.1 time: 0.187499 Apr 13 22:58:30 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 93/277] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 22:58:30 2023] POST /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:58:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-595dbc77-0113-41ac-a8d7-52d03c7a2e78 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:30 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-595dbc77-0113-41ac-a8d7-52d03c7a2e78 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-595dbc77-0113-41ac-a8d7-52d03c7a2e78 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-595dbc77-0113-41ac-a8d7-52d03c7a2e78 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-595dbc77-0113-41ac-a8d7-52d03c7a2e78 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-595dbc77-0113-41ac-a8d7-52d03c7a2e78 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-595dbc77-0113-41ac-a8d7-52d03c7a2e78 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-595dbc77-0113-41ac-a8d7-52d03c7a2e78 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:30 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-595dbc77-0113-41ac-a8d7-52d03c7a2e78 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.086739 Apr 13 22:58:30 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 94/278] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 22:58:30 2023] GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499/os-interface => generated 282 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:58:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-926c05d8-6397-44ed-85f0-de3d74a039ab req-6d399704-5e6e-49d2-aa0e-69cc398054b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f241623-e618-42eb-87d1-0606e37ec499", "name": "network-vif-unplugged", "status": "completed", "tag": "87e984d6-f653-4e7e-a230-53cd27a17d97"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-926c05d8-6397-44ed-85f0-de3d74a039ab req-6d399704-5e6e-49d2-aa0e-69cc398054b0 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-926c05d8-6397-44ed-85f0-de3d74a039ab req-6d399704-5e6e-49d2-aa0e-69cc398054b0 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-926c05d8-6397-44ed-85f0-de3d74a039ab req-6d399704-5e6e-49d2-aa0e-69cc398054b0 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:31 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-926c05d8-6397-44ed-85f0-de3d74a039ab req-6d399704-5e6e-49d2-aa0e-69cc398054b0 service nova] Creating event network-vif-unplugged:87e984d6-f653-4e7e-a230-53cd27a17d97 for instance 3f241623-e618-42eb-87d1-0606e37ec499 on user Apr 13 22:58:31 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-926c05d8-6397-44ed-85f0-de3d74a039ab req-6d399704-5e6e-49d2-aa0e-69cc398054b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030074 Apr 13 22:58:31 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 92/279] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:58:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:58:33 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f241623-e618-42eb-87d1-0606e37ec499", "tag": "87e984d6-f653-4e7e-a230-53cd27a17d97"}, {"name": "network-changed", "server_uuid": "3f241623-e618-42eb-87d1-0606e37ec499", "tag": "87e984d6-f653-4e7e-a230-53cd27a17d97"}, {"server_uuid": "3f241623-e618-42eb-87d1-0606e37ec499", "name": "network-vif-plugged", "status": "completed", "tag": "87e984d6-f653-4e7e-a230-53cd27a17d97"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:33 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] Creating event network-changed:87e984d6-f653-4e7e-a230-53cd27a17d97 for instance 3f241623-e618-42eb-87d1-0606e37ec499 on user Apr 13 22:58:33 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] Creating event network-changed:87e984d6-f653-4e7e-a230-53cd27a17d97 for instance 3f241623-e618-42eb-87d1-0606e37ec499 on user Apr 13 22:58:33 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] Creating event network-vif-plugged:87e984d6-f653-4e7e-a230-53cd27a17d97 for instance 3f241623-e618-42eb-87d1-0606e37ec499 on user Apr 13 22:58:33 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.127204 Apr 13 22:58:33 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 94/280] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:58:33 2023] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:58:33 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-50b4b201-6644-449a-a1c2-fe37096ac1d2 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:33 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-50b4b201-6644-449a-a1c2-fe37096ac1d2 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-50b4b201-6644-449a-a1c2-fe37096ac1d2 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-50b4b201-6644-449a-a1c2-fe37096ac1d2 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-50b4b201-6644-449a-a1c2-fe37096ac1d2 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-50b4b201-6644-449a-a1c2-fe37096ac1d2 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-50b4b201-6644-449a-a1c2-fe37096ac1d2 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-50b4b201-6644-449a-a1c2-fe37096ac1d2 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:33 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-50b4b201-6644-449a-a1c2-fe37096ac1d2 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:58:33 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-50b4b201-6644-449a-a1c2-fe37096ac1d2 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555" status: 200 len: 1491 microversion: 2.1 time: 0.515785 Apr 13 22:58:33 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 95/281] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:58:33 2023] GET /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555 => generated 1491 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:58:35 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-b8560b1f-93b3-47d4-812f-2d1f2ccfa003 req-e48625f3-a7b3-4cd4-a983-7215a2ac2589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f241623-e618-42eb-87d1-0606e37ec499", "name": "network-vif-plugged", "status": "completed", "tag": "87e984d6-f653-4e7e-a230-53cd27a17d97"}, {"server_uuid": "3f241623-e618-42eb-87d1-0606e37ec499", "name": "network-vif-plugged", "status": "completed", "tag": "87e984d6-f653-4e7e-a230-53cd27a17d97"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b8560b1f-93b3-47d4-812f-2d1f2ccfa003 req-e48625f3-a7b3-4cd4-a983-7215a2ac2589 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b8560b1f-93b3-47d4-812f-2d1f2ccfa003 req-e48625f3-a7b3-4cd4-a983-7215a2ac2589 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b8560b1f-93b3-47d4-812f-2d1f2ccfa003 req-e48625f3-a7b3-4cd4-a983-7215a2ac2589 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:35 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-b8560b1f-93b3-47d4-812f-2d1f2ccfa003 req-e48625f3-a7b3-4cd4-a983-7215a2ac2589 service nova] Creating event network-vif-plugged:87e984d6-f653-4e7e-a230-53cd27a17d97 for instance 3f241623-e618-42eb-87d1-0606e37ec499 on user Apr 13 22:58:35 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-b8560b1f-93b3-47d4-812f-2d1f2ccfa003 req-e48625f3-a7b3-4cd4-a983-7215a2ac2589 service nova] Creating event network-vif-plugged:87e984d6-f653-4e7e-a230-53cd27a17d97 for instance 3f241623-e618-42eb-87d1-0606e37ec499 on user Apr 13 22:58:35 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-b8560b1f-93b3-47d4-812f-2d1f2ccfa003 req-e48625f3-a7b3-4cd4-a983-7215a2ac2589 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028825 Apr 13 22:58:35 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 93/282] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:58:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:58:40 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-6a65a2e2-9dc5-43c9-9338-beb58eee8b60 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:40 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-6a65a2e2-9dc5-43c9-9338-beb58eee8b60 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:40 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6a65a2e2-9dc5-43c9-9338-beb58eee8b60 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:40 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6a65a2e2-9dc5-43c9-9338-beb58eee8b60 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:40 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6a65a2e2-9dc5-43c9-9338-beb58eee8b60 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:40 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6a65a2e2-9dc5-43c9-9338-beb58eee8b60 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:40 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6a65a2e2-9dc5-43c9-9338-beb58eee8b60 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:40 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6a65a2e2-9dc5-43c9-9338-beb58eee8b60 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:40 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-6a65a2e2-9dc5-43c9-9338-beb58eee8b60 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.163000 Apr 13 22:58:40 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 95/283] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:58:40 2023] GET /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/os-volume_attachments => generated 25 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 22:58:40 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:40 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:40 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:58:40 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63" status: 204 len: 0 microversion: 2.1 time: 0.104603 Apr 13 22:58:40 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 96/284] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:58:40 2023] DELETE /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:58:40 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-d2e83860-e074-4ba1-979e-a10b93785ac3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:40 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-d2e83860-e074-4ba1-979e-a10b93785ac3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d2e83860-e074-4ba1-979e-a10b93785ac3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d2e83860-e074-4ba1-979e-a10b93785ac3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d2e83860-e074-4ba1-979e-a10b93785ac3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d2e83860-e074-4ba1-979e-a10b93785ac3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d2e83860-e074-4ba1-979e-a10b93785ac3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d2e83860-e074-4ba1-979e-a10b93785ac3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:41 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-d2e83860-e074-4ba1-979e-a10b93785ac3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98594f3f6ccf4ffdbfd91bcf192d936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ccac99656842aca44f9f1eb7aa167a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:58:41 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-d2e83860-e074-4ba1-979e-a10b93785ac3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63" status: 200 len: 1670 microversion: 2.1 time: 0.250995 Apr 13 22:58:41 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 94/285] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:58:40 2023] GET /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63 => generated 1670 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 22:58:41 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:41 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:41 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-331ea116-b02e-463c-b136-bcf364b82295 req-8df41a99-ed34-4715-9619-7557470d40ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e10dfa7-4997-44b0-b26d-421c7a2d8b63", "name": "network-vif-unplugged", "status": "completed", "tag": "822bdb49-5f9a-4949-8543-929b1764e810"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:41 user devstack@n-api.service[61613]: DEBUG nova.objects.instance [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'services' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=61613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:58:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-331ea116-b02e-463c-b136-bcf364b82295 req-8df41a99-ed34-4715-9619-7557470d40ee service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-331ea116-b02e-463c-b136-bcf364b82295 req-8df41a99-ed34-4715-9619-7557470d40ee service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-331ea116-b02e-463c-b136-bcf364b82295 req-8df41a99-ed34-4715-9619-7557470d40ee service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:41 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-331ea116-b02e-463c-b136-bcf364b82295 req-8df41a99-ed34-4715-9619-7557470d40ee service nova] Creating event network-vif-unplugged:822bdb49-5f9a-4949-8543-929b1764e810 for instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 on user Apr 13 22:58:41 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-331ea116-b02e-463c-b136-bcf364b82295 req-8df41a99-ed34-4715-9619-7557470d40ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107291 Apr 13 22:58:41 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 97/286] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:58:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:58:41 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b/os-volume_attachments/a58090c7-ce32-4a3f-a2f0-f327259775e7" status: 202 len: 0 microversion: 2.1 time: 0.309577 Apr 13 22:58:41 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 96/287] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 22:58:41 2023] DELETE /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b/os-volume_attachments/a58090c7-ce32-4a3f-a2f0-f327259775e7 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:58:43 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-d8a16bff-e378-4ee7-a9f5-25e4f00d0f0e req-e47e366b-adef-4f51-bdfc-f7c8bc365e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e10dfa7-4997-44b0-b26d-421c7a2d8b63", "name": "network-vif-deleted", "tag": "822bdb49-5f9a-4949-8543-929b1764e810"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d8a16bff-e378-4ee7-a9f5-25e4f00d0f0e req-e47e366b-adef-4f51-bdfc-f7c8bc365e8c service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d8a16bff-e378-4ee7-a9f5-25e4f00d0f0e req-e47e366b-adef-4f51-bdfc-f7c8bc365e8c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d8a16bff-e378-4ee7-a9f5-25e4f00d0f0e req-e47e366b-adef-4f51-bdfc-f7c8bc365e8c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:43 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-d8a16bff-e378-4ee7-a9f5-25e4f00d0f0e req-e47e366b-adef-4f51-bdfc-f7c8bc365e8c service nova] Creating event network-vif-deleted:822bdb49-5f9a-4949-8543-929b1764e810 for instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 on user Apr 13 22:58:43 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-d8a16bff-e378-4ee7-a9f5-25e4f00d0f0e req-e47e366b-adef-4f51-bdfc-f7c8bc365e8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083948 Apr 13 22:58:43 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 95/288] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:58:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:58:43 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-cfec60f9-3471-4e28-b4be-f6cf178504d4 req-44e76c87-a157-4616-bd0d-66c539ff759a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e10dfa7-4997-44b0-b26d-421c7a2d8b63", "name": "network-vif-plugged", "status": "completed", "tag": "822bdb49-5f9a-4949-8543-929b1764e810"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-cfec60f9-3471-4e28-b4be-f6cf178504d4 req-44e76c87-a157-4616-bd0d-66c539ff759a service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-cfec60f9-3471-4e28-b4be-f6cf178504d4 req-44e76c87-a157-4616-bd0d-66c539ff759a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-cfec60f9-3471-4e28-b4be-f6cf178504d4 req-44e76c87-a157-4616-bd0d-66c539ff759a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:43 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-cfec60f9-3471-4e28-b4be-f6cf178504d4 req-44e76c87-a157-4616-bd0d-66c539ff759a service nova] Creating event network-vif-plugged:822bdb49-5f9a-4949-8543-929b1764e810 for instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 on user Apr 13 22:58:43 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-cfec60f9-3471-4e28-b4be-f6cf178504d4 req-44e76c87-a157-4616-bd0d-66c539ff759a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028508 Apr 13 22:58:43 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 98/289] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:58:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:58:43 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-c5886cef-5ee7-4f83-b277-1eb0486518b4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:43 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c5886cef-5ee7-4f83-b277-1eb0486518b4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:43 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c5886cef-5ee7-4f83-b277-1eb0486518b4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:43 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c5886cef-5ee7-4f83-b277-1eb0486518b4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:43 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-c5886cef-5ee7-4f83-b277-1eb0486518b4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Going to try to stop instance {{(pid=61613) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 13 22:58:43 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-c5886cef-5ee7-4f83-b277-1eb0486518b4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "POST /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b/action" status: 202 len: 0 microversion: 2.1 time: 0.072601 Apr 13 22:58:43 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 97/290] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 22:58:43 2023] POST /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:58:43 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-c47f53e6-a6df-446c-975a-d08c4b042d0d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:43 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-c47f53e6-a6df-446c-975a-d08c4b042d0d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c47f53e6-a6df-446c-975a-d08c4b042d0d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c47f53e6-a6df-446c-975a-d08c4b042d0d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c47f53e6-a6df-446c-975a-d08c4b042d0d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c47f53e6-a6df-446c-975a-d08c4b042d0d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c47f53e6-a6df-446c-975a-d08c4b042d0d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c47f53e6-a6df-446c-975a-d08c4b042d0d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:43 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-c47f53e6-a6df-446c-975a-d08c4b042d0d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b46af525dd45678b69207e93683ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0648ea953174a8cae6085ac24d92bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:58:43 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-c47f53e6-a6df-446c-975a-d08c4b042d0d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b" status: 200 len: 1662 microversion: 2.1 time: 0.184342 Apr 13 22:58:43 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 96/291] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:58:43 2023] GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b => generated 1662 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:58:44 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-1f778884-7d15-42f8-9520-64916c4c39d9 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:44 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-1f778884-7d15-42f8-9520-64916c4c39d9 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1f778884-7d15-42f8-9520-64916c4c39d9 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1f778884-7d15-42f8-9520-64916c4c39d9 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1f778884-7d15-42f8-9520-64916c4c39d9 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1f778884-7d15-42f8-9520-64916c4c39d9 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1f778884-7d15-42f8-9520-64916c4c39d9 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1f778884-7d15-42f8-9520-64916c4c39d9 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:44 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-1f778884-7d15-42f8-9520-64916c4c39d9 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:58:44 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-1f778884-7d15-42f8-9520-64916c4c39d9 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138" status: 200 len: 1537 microversion: 2.1 time: 0.135122 Apr 13 22:58:44 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 99/292] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:58:44 2023] GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138 => generated 1537 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:58:44 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-845a3ab2-c135-488b-8f61-83e96d3446e2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:44 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-845a3ab2-c135-488b-8f61-83e96d3446e2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:58:44 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-845a3ab2-c135-488b-8f61-83e96d3446e2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Searching by: {'deleted': False, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb'} {{(pid=61613) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 13 22:58:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-845a3ab2-c135-488b-8f61-83e96d3446e2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-845a3ab2-c135-488b-8f61-83e96d3446e2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-845a3ab2-c135-488b-8f61-83e96d3446e2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-845a3ab2-c135-488b-8f61-83e96d3446e2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-845a3ab2-c135-488b-8f61-83e96d3446e2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-845a3ab2-c135-488b-8f61-83e96d3446e2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:44 user devstack@n-api.service[61613]: DEBUG nova.compute.multi_cell_list [None req-845a3ab2-c135-488b-8f61-83e96d3446e2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 13 22:58:44 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-845a3ab2-c135-488b-8f61-83e96d3446e2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.243814 Apr 13 22:58:44 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 98/293] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 13 22:58:44 2023] GET /compute/v2.1/servers => generated 341 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:58:44 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-84248584-1fe4-481b-8b21-bd93428e9f60 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:44 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-84248584-1fe4-481b-8b21-bd93428e9f60 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-84248584-1fe4-481b-8b21-bd93428e9f60 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-84248584-1fe4-481b-8b21-bd93428e9f60 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-84248584-1fe4-481b-8b21-bd93428e9f60 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-84248584-1fe4-481b-8b21-bd93428e9f60 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-84248584-1fe4-481b-8b21-bd93428e9f60 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-84248584-1fe4-481b-8b21-bd93428e9f60 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:44 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-84248584-1fe4-481b-8b21-bd93428e9f60 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:58:44 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-84248584-1fe4-481b-8b21-bd93428e9f60 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138" status: 200 len: 1537 microversion: 2.1 time: 0.256521 Apr 13 22:58:44 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 97/294] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:58:44 2023] GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138 => generated 1537 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:58:45 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e1fa88-8896-4198-af4d-56d44baf3b9b", "name": "network-vif-unplugged", "status": "completed", "tag": "94c47f47-2ee7-46d0-858d-a5ff3270a80b"}, {"server_uuid": "92e1fa88-8896-4198-af4d-56d44baf3b9b", "name": "network-vif-plugged", "status": "completed", "tag": "94c47f47-2ee7-46d0-858d-a5ff3270a80b"}, {"server_uuid": "92e1fa88-8896-4198-af4d-56d44baf3b9b", "name": "network-vif-plugged", "status": "completed", "tag": "94c47f47-2ee7-46d0-858d-a5ff3270a80b"}, {"server_uuid": "92e1fa88-8896-4198-af4d-56d44baf3b9b", "name": "network-vif-plugged", "status": "completed", "tag": "94c47f47-2ee7-46d0-858d-a5ff3270a80b"}, {"server_uuid": "92e1fa88-8896-4198-af4d-56d44baf3b9b", "name": "network-vif-unplugged", "status": "completed", "tag": "94c47f47-2ee7-46d0-858d-a5ff3270a80b"}, {"server_uuid": "92e1fa88-8896-4198-af4d-56d44baf3b9b", "name": "network-vif-plugged", "status": "completed", "tag": "94c47f47-2ee7-46d0-858d-a5ff3270a80b"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:45 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Creating event network-vif-unplugged:94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b on user Apr 13 22:58:45 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Creating event network-vif-plugged:94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b on user Apr 13 22:58:45 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Creating event network-vif-plugged:94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b on user Apr 13 22:58:45 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Creating event network-vif-plugged:94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b on user Apr 13 22:58:45 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Creating event network-vif-unplugged:94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b on user Apr 13 22:58:45 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Creating event network-vif-plugged:94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b on user Apr 13 22:58:45 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1042 microversion: 2.1 time: 0.034424 Apr 13 22:58:45 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 100/295] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:58:45 2023] POST /compute/v2.1/os-server-external-events => generated 1042 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 22:58:47 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:47 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:48 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.681600 Apr 13 22:58:48 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 99/296] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:58:47 2023] POST /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138/os-volume_attachments => generated 194 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:58:52 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-85fae2d1-b3e5-42bd-a5c9-e5eba5e08e5a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:52 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-85fae2d1-b3e5-42bd-a5c9-e5eba5e08e5a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-85fae2d1-b3e5-42bd-a5c9-e5eba5e08e5a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-85fae2d1-b3e5-42bd-a5c9-e5eba5e08e5a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-85fae2d1-b3e5-42bd-a5c9-e5eba5e08e5a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-85fae2d1-b3e5-42bd-a5c9-e5eba5e08e5a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-85fae2d1-b3e5-42bd-a5c9-e5eba5e08e5a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-85fae2d1-b3e5-42bd-a5c9-e5eba5e08e5a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:53 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-85fae2d1-b3e5-42bd-a5c9-e5eba5e08e5a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:58:53 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-85fae2d1-b3e5-42bd-a5c9-e5eba5e08e5a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6" status: 200 len: 1393 microversion: 2.1 time: 0.170326 Apr 13 22:58:53 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 98/297] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:58:52 2023] GET /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6 => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:58:53 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f5589694-b235-4371-b40e-d991740f219f tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-321252709"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:53 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f5589694-b235-4371-b40e-d991740f219f tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f5589694-b235-4371-b40e-d991740f219f tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f5589694-b235-4371-b40e-d991740f219f tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f5589694-b235-4371-b40e-d991740f219f tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f5589694-b235-4371-b40e-d991740f219f tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f5589694-b235-4371-b40e-d991740f219f tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f5589694-b235-4371-b40e-d991740f219f tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:53 user devstack@n-api.service[61611]: INFO nova.compute.api [None req-f5589694-b235-4371-b40e-d991740f219f tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Attempting to quiesce instance before volume snapshot. Apr 13 22:58:53 user devstack@n-api.service[61611]: INFO nova.compute.api [None req-f5589694-b235-4371-b40e-d991740f219f tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 13 22:58:53 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f5589694-b235-4371-b40e-d991740f219f tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Creating snapshot from volume ca6e2122-7182-409a-ac67-4361de1d68a1. {{(pid=61611) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 13 22:58:53 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:58:54 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-38740ce5-0827-417b-8685-b1208f08fab8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:54 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-38740ce5-0827-417b-8685-b1208f08fab8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-38740ce5-0827-417b-8685-b1208f08fab8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-38740ce5-0827-417b-8685-b1208f08fab8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-38740ce5-0827-417b-8685-b1208f08fab8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-38740ce5-0827-417b-8685-b1208f08fab8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-38740ce5-0827-417b-8685-b1208f08fab8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-38740ce5-0827-417b-8685-b1208f08fab8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:54 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-38740ce5-0827-417b-8685-b1208f08fab8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] HTTP exception thrown: Instance c10b97ca-3231-41fe-9de5-03cd6dc81e07 could not be found. Apr 13 22:58:54 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-38740ce5-0827-417b-8685-b1208f08fab8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Request method failure captured: Apr 13 22:58:54 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/c10b97ca-3231-41fe-9de5-03cd6dc81e07 HTTP/1.1 Apr 13 22:58:54 user devstack@n-api.service[61613]: Accept: application/json Apr 13 22:58:54 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 22:58:54 user devstack@n-api.service[61613]: Connection: close Apr 13 22:58:54 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 22:58:54 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 22:58:54 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 22:58:54 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 22:58:54 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 22:58:54 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIfCeiGFUPfFKol5aXy6jX9sLH3vWx33vzjitaeTHf-nml7q5FZK43PuHKLvBZlgX8jSs2pa7zTc-gUNjluzyxBdSKplXrD7npwieH_pnQMw6VFqxpwPR3Mxm35AJTWEftEeO-lMs-SxQazfpmr9ETR-K47eMor60C2tGKH_ZvX_Z6Q Apr 13 22:58:54 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 22:58:54 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 22:58:54 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 22:58:54 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 22:58:54 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 22:58:54 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 22:58:54 user devstack@n-api.service[61613]: X-Project-Id: a33cf3bf67714b0ba9c7f703a1c9e5b9 Apr 13 22:58:54 user devstack@n-api.service[61613]: X-Project-Name: tempest-VolumesAdminNegativeTest-357530992 Apr 13 22:58:54 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 22:58:54 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 22:58:54 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a33cf3bf67714b0ba9c7f703a1c9e5b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a33cf3bf67714b0ba9c7f703a1c9e5b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a33cf3bf67714b0ba9c7f703a1c9e5b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:58:54 user devstack@n-api.service[61613]: X-Tenant: tempest-VolumesAdminNegativeTest-357530992 Apr 13 22:58:54 user devstack@n-api.service[61613]: X-Tenant-Id: a33cf3bf67714b0ba9c7f703a1c9e5b9 Apr 13 22:58:54 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-357530992 Apr 13 22:58:54 user devstack@n-api.service[61613]: X-User: tempest-VolumesAdminNegativeTest-357530992-project-member Apr 13 22:58:54 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 22:58:54 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 22:58:54 user devstack@n-api.service[61613]: X-User-Id: e1b08dea04784bc3b07195f951a84bfb Apr 13 22:58:54 user devstack@n-api.service[61613]: X-User-Name: tempest-VolumesAdminNegativeTest-357530992-project-member Apr 13 22:58:54 user devstack@n-api.service[61613]: method: > Apr 13 22:58:54 user devstack@n-api.service[61613]: exception: Instance c10b97ca-3231-41fe-9de5-03cd6dc81e07 could not be found. Apr 13 22:58:54 user devstack@n-api.service[61613]: action_args: {'id': 'c10b97ca-3231-41fe-9de5-03cd6dc81e07'} Apr 13 22:58:54 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c10b97ca-3231-41fe-9de5-03cd6dc81e07 could not be found. Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c10b97ca-3231-41fe-9de5-03cd6dc81e07 could not be found. Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c10b97ca-3231-41fe-9de5-03cd6dc81e07 could not be found. Apr 13 22:58:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 22:58:54 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-38740ce5-0827-417b-8685-b1208f08fab8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Returning 404 to user: Instance c10b97ca-3231-41fe-9de5-03cd6dc81e07 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:58:54 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-38740ce5-0827-417b-8685-b1208f08fab8 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c10b97ca-3231-41fe-9de5-03cd6dc81e07" status: 404 len: 111 microversion: 2.1 time: 0.175357 Apr 13 22:58:54 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 100/298] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:58:54 2023] GET /compute/v2.1/servers/c10b97ca-3231-41fe-9de5-03cd6dc81e07 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:58:55 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f5589694-b235-4371-b40e-d991740f219f tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "POST /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6/action" status: 202 len: 0 microversion: 2.1 time: 2.607140 Apr 13 22:58:55 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 101/299] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 22:58:53 2023] POST /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6/action => generated 0 bytes in 2609 msecs (HTTP/1.1 202) 10 headers in 449 bytes (2 switches on core 0) Apr 13 22:58:56 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-853709521", "imageRef": "7119a410-f029-4b60-b10c-446ba970d825", "flavorRef": "42", "networks": [{"uuid": "aadb940e-808f-4d62-87fe-765d072b7c2f"}]}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:56 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] validate_networks() for [('aadb940e-808f-4d62-87fe-765d072b7c2f', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:58:56 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:58:56 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:58:56 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:58:56 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:58:56 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:58:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:56 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting quotas for project d872848d5dc1471996e2f33bbbdebbd9. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:58:56 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting quotas for user b289294050af4c41aeef8401832487a1 and project d872848d5dc1471996e2f33bbbdebbd9. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:58:56 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:58:56 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='826ff984-42c6-41d0-9b1e-47e388886d7b',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:58:56 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.565742 Apr 13 22:58:56 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 99/300] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:58:56 2023] POST /compute/v2.1/servers => generated 378 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:58:56 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-22467163-3c37-442f-bd59-2aa843c0a594 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:56 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-22467163-3c37-442f-bd59-2aa843c0a594 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:56 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:58:56 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-22467163-3c37-442f-bd59-2aa843c0a594 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:58:56 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-22467163-3c37-442f-bd59-2aa843c0a594 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc51e254-7d38-49f6-816e-947d92f95950" status: 200 len: 1223 microversion: 2.1 time: 0.079481 Apr 13 22:58:56 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 101/301] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:58:56 2023] GET /compute/v2.1/servers/bc51e254-7d38-49f6-816e-947d92f95950 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:58:57 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f74f3f7c-0a70-47e9-94ad-c9bbc3d7963f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:57 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f74f3f7c-0a70-47e9-94ad-c9bbc3d7963f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:57 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:58:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f74f3f7c-0a70-47e9-94ad-c9bbc3d7963f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f74f3f7c-0a70-47e9-94ad-c9bbc3d7963f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f74f3f7c-0a70-47e9-94ad-c9bbc3d7963f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f74f3f7c-0a70-47e9-94ad-c9bbc3d7963f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f74f3f7c-0a70-47e9-94ad-c9bbc3d7963f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f74f3f7c-0a70-47e9-94ad-c9bbc3d7963f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:57 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-f74f3f7c-0a70-47e9-94ad-c9bbc3d7963f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec0b2d09be54070ab00037165788f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b1ce9b9f4d4adf8316110aae9e04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:58:57 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-f74f3f7c-0a70-47e9-94ad-c9bbc3d7963f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ec0b2d09be54070ab00037165788f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b1ce9b9f4d4adf8316110aae9e04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:58:57 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-f74f3f7c-0a70-47e9-94ad-c9bbc3d7963f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ec0b2d09be54070ab00037165788f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b1ce9b9f4d4adf8316110aae9e04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:58:57 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f74f3f7c-0a70-47e9-94ad-c9bbc3d7963f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a" status: 200 len: 1624 microversion: 2.49 time: 0.234937 Apr 13 22:58:57 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 102/302] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:58:57 2023] GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a => generated 1624 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 22:58:57 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:57 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:57 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Going to try to terminate instance {{(pid=61612) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:58:57 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063" status: 204 len: 0 microversion: 2.1 time: 0.143551 Apr 13 22:58:57 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 100/303] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:58:57 2023] DELETE /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:58:57 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-b21858fa-be56-46d6-b07a-918403d25a2c tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:57 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-b21858fa-be56-46d6-b07a-918403d25a2c tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b21858fa-be56-46d6-b07a-918403d25a2c tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b21858fa-be56-46d6-b07a-918403d25a2c tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b21858fa-be56-46d6-b07a-918403d25a2c tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b21858fa-be56-46d6-b07a-918403d25a2c tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b21858fa-be56-46d6-b07a-918403d25a2c tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b21858fa-be56-46d6-b07a-918403d25a2c tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:58 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-b21858fa-be56-46d6-b07a-918403d25a2c tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b08dea04784bc3b07195f951a84bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33cf3bf67714b0ba9c7f703a1c9e5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:58:58 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-b21858fa-be56-46d6-b07a-918403d25a2c tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063" status: 200 len: 1667 microversion: 2.1 time: 0.257641 Apr 13 22:58:58 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 102/304] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:58:57 2023] GET /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063 => generated 1667 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 22:58:58 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-de1bd67f-af4b-4d6b-a596-83e9ab0e8860 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:58:58 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-de1bd67f-af4b-4d6b-a596-83e9ab0e8860 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:58:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-de1bd67f-af4b-4d6b-a596-83e9ab0e8860 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-de1bd67f-af4b-4d6b-a596-83e9ab0e8860 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-de1bd67f-af4b-4d6b-a596-83e9ab0e8860 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-de1bd67f-af4b-4d6b-a596-83e9ab0e8860 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-de1bd67f-af4b-4d6b-a596-83e9ab0e8860 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-de1bd67f-af4b-4d6b-a596-83e9ab0e8860 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:58 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-1cff86b6-d8ce-4658-b7a7-e9dfbcfb7e26 req-ca512dd4-e70d-44ea-b553-4da780e0efb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2355fe9d-511a-4e7c-ac2a-5bddc034e063", "name": "network-vif-unplugged", "status": "completed", "tag": "3958622e-6a70-4931-b630-26e0a53c5755"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:58:58 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-de1bd67f-af4b-4d6b-a596-83e9ab0e8860 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:58:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-1cff86b6-d8ce-4658-b7a7-e9dfbcfb7e26 req-ca512dd4-e70d-44ea-b553-4da780e0efb6 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:58:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-1cff86b6-d8ce-4658-b7a7-e9dfbcfb7e26 req-ca512dd4-e70d-44ea-b553-4da780e0efb6 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:58:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-1cff86b6-d8ce-4658-b7a7-e9dfbcfb7e26 req-ca512dd4-e70d-44ea-b553-4da780e0efb6 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:58:58 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-1cff86b6-d8ce-4658-b7a7-e9dfbcfb7e26 req-ca512dd4-e70d-44ea-b553-4da780e0efb6 service nova] Creating event network-vif-unplugged:3958622e-6a70-4931-b630-26e0a53c5755 for instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 on user Apr 13 22:58:58 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-1cff86b6-d8ce-4658-b7a7-e9dfbcfb7e26 req-ca512dd4-e70d-44ea-b553-4da780e0efb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029620 Apr 13 22:58:58 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 101/305] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:58:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:58:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-de1bd67f-af4b-4d6b-a596-83e9ab0e8860 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138" status: 200 len: 1583 microversion: 2.1 time: 0.237571 Apr 13 22:58:58 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 103/306] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:58:58 2023] GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138 => generated 1583 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 22:59:00 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2355fe9d-511a-4e7c-ac2a-5bddc034e063", "name": "network-vif-plugged", "status": "completed", "tag": "3958622e-6a70-4931-b630-26e0a53c5755"}, {"server_uuid": "2355fe9d-511a-4e7c-ac2a-5bddc034e063", "name": "network-vif-deleted", "tag": "3958622e-6a70-4931-b630-26e0a53c5755"}, {"name": "network-changed", "server_uuid": "bc51e254-7d38-49f6-816e-947d92f95950", "tag": "b06270a1-7c20-4d1a-98b7-4dafc26585e2"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:00 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=23 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:00 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:00 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:00 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:00 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:00 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] Creating event network-vif-plugged:3958622e-6a70-4931-b630-26e0a53c5755 for instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 on user Apr 13 22:59:00 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] Creating event network-vif-deleted:3958622e-6a70-4931-b630-26e0a53c5755 for instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 on user Apr 13 22:59:00 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] Creating event network-changed:b06270a1-7c20-4d1a-98b7-4dafc26585e2 for instance bc51e254-7d38-49f6-816e-947d92f95950 on user Apr 13 22:59:00 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.051959 Apr 13 22:59:00 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 103/307] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:00 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:00 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-bfd39197-e420-4b53-be47-311218568a9e req-db8864ce-7188-41c6-bca3-c52a5d1e777b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b190941d-9f62-41ef-881d-e02d246e9138", "tag": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:00 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-bfd39197-e420-4b53-be47-311218568a9e req-db8864ce-7188-41c6-bca3-c52a5d1e777b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-bfd39197-e420-4b53-be47-311218568a9e req-db8864ce-7188-41c6-bca3-c52a5d1e777b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-bfd39197-e420-4b53-be47-311218568a9e req-db8864ce-7188-41c6-bca3-c52a5d1e777b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:00 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:00 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-bfd39197-e420-4b53-be47-311218568a9e req-db8864ce-7188-41c6-bca3-c52a5d1e777b service nova] Creating event network-changed:37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance b190941d-9f62-41ef-881d-e02d246e9138 on user Apr 13 22:59:00 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-bfd39197-e420-4b53-be47-311218568a9e req-db8864ce-7188-41c6-bca3-c52a5d1e777b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045325 Apr 13 22:59:00 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 102/308] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:02 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f2947068-beb6-45df-9cad-4fda4650cc63 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1854904717"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:02 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f2947068-beb6-45df-9cad-4fda4650cc63 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f2947068-beb6-45df-9cad-4fda4650cc63 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f2947068-beb6-45df-9cad-4fda4650cc63 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f2947068-beb6-45df-9cad-4fda4650cc63 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f2947068-beb6-45df-9cad-4fda4650cc63 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f2947068-beb6-45df-9cad-4fda4650cc63 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f2947068-beb6-45df-9cad-4fda4650cc63 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:02 user devstack@n-api.service[61611]: INFO nova.network.security_group_api [None req-f2947068-beb6-45df-9cad-4fda4650cc63 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Adding security group c4ec2504-93fe-4c05-8923-148e032f3b1b to port 37865aaf-d7fb-4f6b-b764-2b75e9d3e924 Apr 13 22:59:02 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f2947068-beb6-45df-9cad-4fda4650cc63 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138/action" status: 202 len: 0 microversion: 2.1 time: 0.596763 Apr 13 22:59:02 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 104/309] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 22:59:02 2023] POST /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:59:02 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-0dfd26c9-f926-4d2e-8d6d-80c5d4c597c6 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:59:02 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-0dfd26c9-f926-4d2e-8d6d-80c5d4c597c6 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0dfd26c9-f926-4d2e-8d6d-80c5d4c597c6 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0dfd26c9-f926-4d2e-8d6d-80c5d4c597c6 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0dfd26c9-f926-4d2e-8d6d-80c5d4c597c6 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0dfd26c9-f926-4d2e-8d6d-80c5d4c597c6 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0dfd26c9-f926-4d2e-8d6d-80c5d4c597c6 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0dfd26c9-f926-4d2e-8d6d-80c5d4c597c6 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:02 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-3222cc25-6383-4f54-a4cd-13d23a4d929c req-bf1575c5-bd14-47b2-a8a8-faf7bf22ac68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b190941d-9f62-41ef-881d-e02d246e9138", "tag": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-3222cc25-6383-4f54-a4cd-13d23a4d929c req-bf1575c5-bd14-47b2-a8a8-faf7bf22ac68 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-3222cc25-6383-4f54-a4cd-13d23a4d929c req-bf1575c5-bd14-47b2-a8a8-faf7bf22ac68 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-3222cc25-6383-4f54-a4cd-13d23a4d929c req-bf1575c5-bd14-47b2-a8a8-faf7bf22ac68 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-3222cc25-6383-4f54-a4cd-13d23a4d929c req-bf1575c5-bd14-47b2-a8a8-faf7bf22ac68 service nova] Creating event network-changed:37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance b190941d-9f62-41ef-881d-e02d246e9138 on user Apr 13 22:59:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-3222cc25-6383-4f54-a4cd-13d23a4d929c req-bf1575c5-bd14-47b2-a8a8-faf7bf22ac68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034497 Apr 13 22:59:02 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 103/310] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:03 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-0dfd26c9-f926-4d2e-8d6d-80c5d4c597c6 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:59:03 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-0dfd26c9-f926-4d2e-8d6d-80c5d4c597c6 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138" status: 200 len: 1748 microversion: 2.1 time: 0.202379 Apr 13 22:59:03 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 104/311] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:59:02 2023] GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138 => generated 1748 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:59:03 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:59:03 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:03 user devstack@n-api.service[61611]: DEBUG nova.objects.instance [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lazy-loading 'services' on Instance uuid 3f241623-e618-42eb-87d1-0606e37ec499 {{(pid=61611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:59:03 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499/os-volume_attachments/ad4438c6-dc98-4b87-b570-3881b3bde779" status: 202 len: 0 microversion: 2.1 time: 0.315044 Apr 13 22:59:03 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 105/312] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 22:59:03 2023] DELETE /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499/os-volume_attachments/ad4438c6-dc98-4b87-b570-3881b3bde779 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:59:03 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-e5e07f18-0822-41af-9233-1f78dafbb8f5 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:59:03 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-e5e07f18-0822-41af-9233-1f78dafbb8f5 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e5e07f18-0822-41af-9233-1f78dafbb8f5 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e5e07f18-0822-41af-9233-1f78dafbb8f5 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e5e07f18-0822-41af-9233-1f78dafbb8f5 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e5e07f18-0822-41af-9233-1f78dafbb8f5 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e5e07f18-0822-41af-9233-1f78dafbb8f5 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e5e07f18-0822-41af-9233-1f78dafbb8f5 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:03 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-e5e07f18-0822-41af-9233-1f78dafbb8f5 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054879 Apr 13 22:59:03 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 104/313] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:59:03 2023] GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:05 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:05 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138/action" status: 202 len: 0 microversion: 2.1 time: 0.089451 Apr 13 22:59:05 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 105/314] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 22:59:05 2023] POST /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:59:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-3b0e08cf-7e6e-4f28-8643-5cdc314f4932 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:59:05 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-3b0e08cf-7e6e-4f28-8643-5cdc314f4932 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3b0e08cf-7e6e-4f28-8643-5cdc314f4932 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3b0e08cf-7e6e-4f28-8643-5cdc314f4932 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3b0e08cf-7e6e-4f28-8643-5cdc314f4932 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3b0e08cf-7e6e-4f28-8643-5cdc314f4932 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3b0e08cf-7e6e-4f28-8643-5cdc314f4932 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3b0e08cf-7e6e-4f28-8643-5cdc314f4932 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:05 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-3b0e08cf-7e6e-4f28-8643-5cdc314f4932 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:59:05 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-3b0e08cf-7e6e-4f28-8643-5cdc314f4932 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138" status: 200 len: 1750 microversion: 2.1 time: 0.163270 Apr 13 22:59:05 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 106/315] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:59:05 2023] GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138 => generated 1750 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:59:06 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-761f8bb2-3587-4a3e-a8bb-d97ec88834dc req-475598ed-1950-4387-82d9-03f0741c94e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b190941d-9f62-41ef-881d-e02d246e9138", "name": "network-vif-unplugged", "status": "completed", "tag": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-761f8bb2-3587-4a3e-a8bb-d97ec88834dc req-475598ed-1950-4387-82d9-03f0741c94e6 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-761f8bb2-3587-4a3e-a8bb-d97ec88834dc req-475598ed-1950-4387-82d9-03f0741c94e6 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-761f8bb2-3587-4a3e-a8bb-d97ec88834dc req-475598ed-1950-4387-82d9-03f0741c94e6 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:06 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-761f8bb2-3587-4a3e-a8bb-d97ec88834dc req-475598ed-1950-4387-82d9-03f0741c94e6 service nova] Creating event network-vif-unplugged:37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance b190941d-9f62-41ef-881d-e02d246e9138 on user Apr 13 22:59:06 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-761f8bb2-3587-4a3e-a8bb-d97ec88834dc req-475598ed-1950-4387-82d9-03f0741c94e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030348 Apr 13 22:59:06 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 105/316] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:08 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:08 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-b3fc2097-45c8-4362-ad7e-3b640f6f9226 req-5671a9db-2130-4f6e-860b-f1554527c3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b190941d-9f62-41ef-881d-e02d246e9138", "name": "network-vif-plugged", "status": "completed", "tag": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-b3fc2097-45c8-4362-ad7e-3b640f6f9226 req-5671a9db-2130-4f6e-860b-f1554527c3a3 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-b3fc2097-45c8-4362-ad7e-3b640f6f9226 req-5671a9db-2130-4f6e-860b-f1554527c3a3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-b3fc2097-45c8-4362-ad7e-3b640f6f9226 req-5671a9db-2130-4f6e-860b-f1554527c3a3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:08 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-b3fc2097-45c8-4362-ad7e-3b640f6f9226 req-5671a9db-2130-4f6e-860b-f1554527c3a3 service nova] Creating event network-vif-plugged:37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance b190941d-9f62-41ef-881d-e02d246e9138 on user Apr 13 22:59:08 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-b3fc2097-45c8-4362-ad7e-3b640f6f9226 req-5671a9db-2130-4f6e-860b-f1554527c3a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029774 Apr 13 22:59:08 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 106/317] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:11 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-8fe7d4ef-7523-4375-a4a9-d7030b681b75 req-94648024-1011-4194-a3e7-1d1477e095e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b190941d-9f62-41ef-881d-e02d246e9138", "name": "network-vif-plugged", "status": "completed", "tag": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-8fe7d4ef-7523-4375-a4a9-d7030b681b75 req-94648024-1011-4194-a3e7-1d1477e095e4 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-8fe7d4ef-7523-4375-a4a9-d7030b681b75 req-94648024-1011-4194-a3e7-1d1477e095e4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-8fe7d4ef-7523-4375-a4a9-d7030b681b75 req-94648024-1011-4194-a3e7-1d1477e095e4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-8fe7d4ef-7523-4375-a4a9-d7030b681b75 req-94648024-1011-4194-a3e7-1d1477e095e4 service nova] Creating event network-vif-plugged:37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance b190941d-9f62-41ef-881d-e02d246e9138 on user Apr 13 22:59:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-8fe7d4ef-7523-4375-a4a9-d7030b681b75 req-94648024-1011-4194-a3e7-1d1477e095e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031699 Apr 13 22:59:11 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 107/318] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:12 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:12 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:12 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-ecfa4b04-c4f1-4df6-a428-9e1fb9e890b4 req-666204c6-04b5-41a1-bf52-a34a89cb6cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc51e254-7d38-49f6-816e-947d92f95950", "name": "network-vif-plugged", "status": "completed", "tag": "b06270a1-7c20-4d1a-98b7-4dafc26585e2"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-ecfa4b04-c4f1-4df6-a428-9e1fb9e890b4 req-666204c6-04b5-41a1-bf52-a34a89cb6cf2 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-ecfa4b04-c4f1-4df6-a428-9e1fb9e890b4 req-666204c6-04b5-41a1-bf52-a34a89cb6cf2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-ecfa4b04-c4f1-4df6-a428-9e1fb9e890b4 req-666204c6-04b5-41a1-bf52-a34a89cb6cf2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:12 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-ecfa4b04-c4f1-4df6-a428-9e1fb9e890b4 req-666204c6-04b5-41a1-bf52-a34a89cb6cf2 service nova] Creating event network-vif-plugged:b06270a1-7c20-4d1a-98b7-4dafc26585e2 for instance bc51e254-7d38-49f6-816e-947d92f95950 on user Apr 13 22:59:12 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-ecfa4b04-c4f1-4df6-a428-9e1fb9e890b4 req-666204c6-04b5-41a1-bf52-a34a89cb6cf2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034382 Apr 13 22:59:12 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 106/319] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:13 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-0eaca87d-3e3f-4c94-a179-466b8622e30c req-16285329-d5ab-4d33-8d73-97ed60461db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b190941d-9f62-41ef-881d-e02d246e9138", "name": "network-vif-plugged", "status": "completed", "tag": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0eaca87d-3e3f-4c94-a179-466b8622e30c req-16285329-d5ab-4d33-8d73-97ed60461db1 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0eaca87d-3e3f-4c94-a179-466b8622e30c req-16285329-d5ab-4d33-8d73-97ed60461db1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0eaca87d-3e3f-4c94-a179-466b8622e30c req-16285329-d5ab-4d33-8d73-97ed60461db1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:13 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-0eaca87d-3e3f-4c94-a179-466b8622e30c req-16285329-d5ab-4d33-8d73-97ed60461db1 service nova] Creating event network-vif-plugged:37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance b190941d-9f62-41ef-881d-e02d246e9138 on user Apr 13 22:59:13 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-0eaca87d-3e3f-4c94-a179-466b8622e30c req-16285329-d5ab-4d33-8d73-97ed60461db1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030384 Apr 13 22:59:13 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 107/320] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:14 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-76016ef8-728b-4908-80f2-a35c0851f4ea req-4d195f78-d90c-45db-9a50-73b321fcddc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc51e254-7d38-49f6-816e-947d92f95950", "name": "network-vif-plugged", "status": "completed", "tag": "b06270a1-7c20-4d1a-98b7-4dafc26585e2"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-76016ef8-728b-4908-80f2-a35c0851f4ea req-4d195f78-d90c-45db-9a50-73b321fcddc9 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-76016ef8-728b-4908-80f2-a35c0851f4ea req-4d195f78-d90c-45db-9a50-73b321fcddc9 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-76016ef8-728b-4908-80f2-a35c0851f4ea req-4d195f78-d90c-45db-9a50-73b321fcddc9 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:14 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-76016ef8-728b-4908-80f2-a35c0851f4ea req-4d195f78-d90c-45db-9a50-73b321fcddc9 service nova] Creating event network-vif-plugged:b06270a1-7c20-4d1a-98b7-4dafc26585e2 for instance bc51e254-7d38-49f6-816e-947d92f95950 on user Apr 13 22:59:14 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-76016ef8-728b-4908-80f2-a35c0851f4ea req-4d195f78-d90c-45db-9a50-73b321fcddc9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028415 Apr 13 22:59:14 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 108/321] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:29 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=9 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:29 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=13 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:29 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1343743038", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "7ea834aa-c724-45fb-9c3f-497360beab67"}]}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:29 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] validate_networks() for [('7ea834aa-c724-45fb-9c3f-497360beab67', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:59:30 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:59:30 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:59:30 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:59:30 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:59:30 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:59:30 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:30 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:30 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:30 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:30 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:30 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:30 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Getting quotas for project 3fe77a2c491c4596ba7e6af3236d7de8. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:59:30 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Getting quotas for user 6db44e7cb89a46c2999916b0a266b159 and project 3fe77a2c491c4596ba7e6af3236d7de8. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:59:30 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:59:30 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:59:30 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.461692 Apr 13 22:59:30 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 107/322] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 22:59:29 2023] POST /compute/v2.1/servers => generated 378 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 22:59:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-287fb8ea-6c03-42c4-b44f-a3ff32d95e3e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:59:30 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-287fb8ea-6c03-42c4-b44f-a3ff32d95e3e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:30 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=9 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:30 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:30 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-287fb8ea-6c03-42c4-b44f-a3ff32d95e3e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:59:30 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-287fb8ea-6c03-42c4-b44f-a3ff32d95e3e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:59:30 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-287fb8ea-6c03-42c4-b44f-a3ff32d95e3e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:59:30 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-287fb8ea-6c03-42c4-b44f-a3ff32d95e3e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8" status: 200 len: 1395 microversion: 2.87 time: 0.074350 Apr 13 22:59:30 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 108/323] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:59:30 2023] GET /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8 => generated 1395 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 22:59:31 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=13 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:31 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5fec70eb-77b6-475c-a38f-f21f2599ef9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:59:31 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-5fec70eb-77b6-475c-a38f-f21f2599ef9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5fec70eb-77b6-475c-a38f-f21f2599ef9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5fec70eb-77b6-475c-a38f-f21f2599ef9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5fec70eb-77b6-475c-a38f-f21f2599ef9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5fec70eb-77b6-475c-a38f-f21f2599ef9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5fec70eb-77b6-475c-a38f-f21f2599ef9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5fec70eb-77b6-475c-a38f-f21f2599ef9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:31 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-5fec70eb-77b6-475c-a38f-f21f2599ef9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] HTTP exception thrown: Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 could not be found. Apr 13 22:59:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5fec70eb-77b6-475c-a38f-f21f2599ef9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Request method failure captured: Apr 13 22:59:31 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63 HTTP/1.1 Apr 13 22:59:31 user devstack@n-api.service[61611]: Accept: application/json Apr 13 22:59:31 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 22:59:31 user devstack@n-api.service[61611]: Connection: close Apr 13 22:59:31 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 22:59:31 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 22:59:31 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 22:59:31 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 22:59:31 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 22:59:31 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIfFTd-GGuNLZhpg908qNRAUWwxNgAfeCUimfaNa0b2DAb_GHBW4t-lVsJou0tz2or0f6bqUrzjLpozKP8y8w6AYyySvjwkcbo4hPrDnlFVSF3sjpEAKCireroRzn4mK7Mj_j8ZmmwDUGWxo3vQ2pAQyz117nhwbP810jFnZYlkUbLs Apr 13 22:59:31 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 22:59:31 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 22:59:31 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 22:59:31 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 22:59:31 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 22:59:31 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 22:59:31 user devstack@n-api.service[61611]: X-Project-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 22:59:31 user devstack@n-api.service[61611]: X-Project-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 22:59:31 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 22:59:31 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 22:59:31 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:59:31 user devstack@n-api.service[61611]: X-Tenant: tempest-AttachVolumeNegativeTest-704876090 Apr 13 22:59:31 user devstack@n-api.service[61611]: X-Tenant-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 22:59:31 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 22:59:31 user devstack@n-api.service[61611]: X-User: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 22:59:31 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 22:59:31 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 22:59:31 user devstack@n-api.service[61611]: X-User-Id: 98594f3f6ccf4ffdbfd91bcf192d936e Apr 13 22:59:31 user devstack@n-api.service[61611]: X-User-Name: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 22:59:31 user devstack@n-api.service[61611]: method: > Apr 13 22:59:31 user devstack@n-api.service[61611]: exception: Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 could not be found. Apr 13 22:59:31 user devstack@n-api.service[61611]: action_args: {'id': '0e10dfa7-4997-44b0-b26d-421c7a2d8b63'} Apr 13 22:59:31 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 could not be found. Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 could not be found. Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 could not be found. Apr 13 22:59:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 22:59:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5fec70eb-77b6-475c-a38f-f21f2599ef9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Returning 404 to user: Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:59:31 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-5fec70eb-77b6-475c-a38f-f21f2599ef9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63" status: 404 len: 111 microversion: 2.1 time: 0.041688 Apr 13 22:59:31 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 109/324] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:59:31 2023] GET /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:59:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-013d1367-0e7e-4b51-8e42-b51b01c4da02 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '.version_select at 0x7f3d1dfb1090>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:59:31 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-013d1367-0e7e-4b51-8e42-b51b01c4da02 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1288429327" status: 202 len: 0 microversion: 2.1 time: 0.024903 Apr 13 22:59:31 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 108/325] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 22:59:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1288429327 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:59:32 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-947b53c1-1973-4a2b-8413-1f6ec265d42c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Action: 'create', calling method: .version_select at 0x7f3d1dd00430>, body: {"keypair": {"name": "tempest-keypair-286597101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdIn2aTmD4XbBsFMXMHNsWX5qBMfL70kIjVQgqdNLj3BfmoaBPPsv0YDGx2+i2qNmJlXMHeZYj/opWigP9CFsZryFVOF7OKgBHSIywAoBb74kwwJDqv4tRlH1o7PgrM9Q=="}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:32 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-947b53c1-1973-4a2b-8413-1f6ec265d42c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting quotas for project 85ccac99656842aca44f9f1eb7aa167a. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:59:32 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-947b53c1-1973-4a2b-8413-1f6ec265d42c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting quotas for user 98594f3f6ccf4ffdbfd91bcf192d936e and project 85ccac99656842aca44f9f1eb7aa167a. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:59:32 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-947b53c1-1973-4a2b-8413-1f6ec265d42c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069980 Apr 13 22:59:32 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 109/326] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 22:59:32 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:33 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-fb76edb0-4e63-49fa-b772-0bfdefe49138 req-81070745-968e-47ae-84e2-3ae54ac36a17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31ec73b0-9b2a-4fc1-be85-4179075afdb8", "tag": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-fb76edb0-4e63-49fa-b772-0bfdefe49138 req-81070745-968e-47ae-84e2-3ae54ac36a17 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-fb76edb0-4e63-49fa-b772-0bfdefe49138 req-81070745-968e-47ae-84e2-3ae54ac36a17 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-fb76edb0-4e63-49fa-b772-0bfdefe49138 req-81070745-968e-47ae-84e2-3ae54ac36a17 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:33 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-fb76edb0-4e63-49fa-b772-0bfdefe49138 req-81070745-968e-47ae-84e2-3ae54ac36a17 service nova] Creating event network-changed:0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 on user Apr 13 22:59:33 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-fb76edb0-4e63-49fa-b772-0bfdefe49138 req-81070745-968e-47ae-84e2-3ae54ac36a17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051685 Apr 13 22:59:33 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 110/327] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:33 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-eb13d2e2-8461-40b1-afb3-32319ac3d7a6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8868fcd-96dd-4314-8026-91836786958f"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:33 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-eb13d2e2-8461-40b1-afb3-32319ac3d7a6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-eb13d2e2-8461-40b1-afb3-32319ac3d7a6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-eb13d2e2-8461-40b1-afb3-32319ac3d7a6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-eb13d2e2-8461-40b1-afb3-32319ac3d7a6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-eb13d2e2-8461-40b1-afb3-32319ac3d7a6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-eb13d2e2-8461-40b1-afb3-32319ac3d7a6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-eb13d2e2-8461-40b1-afb3-32319ac3d7a6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:33 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-eb13d2e2-8461-40b1-afb3-32319ac3d7a6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] HTTP exception thrown: Cannot 'attach_volume' instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 while it is in vm_state rescued Apr 13 22:59:33 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-eb13d2e2-8461-40b1-afb3-32319ac3d7a6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Request method failure captured: Apr 13 22:59:33 user devstack@n-api.service[61612]: request: POST /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555/os-volume_attachments HTTP/1.1 Apr 13 22:59:33 user devstack@n-api.service[61612]: Accept: application/json Apr 13 22:59:33 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 22:59:33 user devstack@n-api.service[61612]: Connection: close Apr 13 22:59:33 user devstack@n-api.service[61612]: Content-Length: 74 Apr 13 22:59:33 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 22:59:33 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 22:59:33 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 22:59:33 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 22:59:33 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIfHQxdyZtX-iu-ThNLEChPZxANikiWLMMCIRZ25gQuq3VxddslsqUB5ikMLZ2ePv4vTU-JsJ6azIW7Ww-AQ-OdqvQt7Sws4Wi7PO44E5yqLWKj1QiMLUT5MdNcavqRLksBSt368wMT-Wgo0vOgAq25fxnYJ3kH5oYJcbmhrlbtbUaQ Apr 13 22:59:33 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 22:59:33 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 22:59:33 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 22:59:33 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 22:59:33 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 22:59:33 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 22:59:33 user devstack@n-api.service[61612]: X-Project-Id: 5b6a1fccc07f4f5a8f8f8617ae03955d Apr 13 22:59:33 user devstack@n-api.service[61612]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-258614246 Apr 13 22:59:33 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 22:59:33 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 22:59:33 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5b6a1fccc07f4f5a8f8f8617ae03955d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b6a1fccc07f4f5a8f8f8617ae03955d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b6a1fccc07f4f5a8f8f8617ae03955d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:59:33 user devstack@n-api.service[61612]: X-Tenant: tempest-ServerRescueNegativeTestJSON-258614246 Apr 13 22:59:33 user devstack@n-api.service[61612]: X-Tenant-Id: 5b6a1fccc07f4f5a8f8f8617ae03955d Apr 13 22:59:33 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-258614246 Apr 13 22:59:33 user devstack@n-api.service[61612]: X-User: tempest-ServerRescueNegativeTestJSON-258614246-project-member Apr 13 22:59:33 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 22:59:33 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 22:59:33 user devstack@n-api.service[61612]: X-User-Id: 28cb6d8d6e3d4ef7aa53bb17faf495c4 Apr 13 22:59:33 user devstack@n-api.service[61612]: X-User-Name: tempest-ServerRescueNegativeTestJSON-258614246-project-member Apr 13 22:59:33 user devstack@n-api.service[61612]: Apr 13 22:59:33 user devstack@n-api.service[61612]: {"volumeAttachment": {"volumeId": "b8868fcd-96dd-4314-8026-91836786958f"}} Apr 13 22:59:33 user devstack@n-api.service[61612]: method: > Apr 13 22:59:33 user devstack@n-api.service[61612]: exception: Cannot 'attach_volume' instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 while it is in vm_state rescued Apr 13 22:59:33 user devstack@n-api.service[61612]: action_args: {'server_id': 'df12dd8d-ea02-4c59-804d-52ae1bd4a555', 'body': {'volumeAttachment': {'volumeId': 'b8868fcd-96dd-4314-8026-91836786958f'}}} Apr 13 22:59:33 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 while it is in vm_state rescued Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 while it is in vm_state rescued Apr 13 22:59:33 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:59:33 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-eb13d2e2-8461-40b1-afb3-32319ac3d7a6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Returning 409 to user: Cannot 'attach_volume' instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 while it is in vm_state rescued {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:59:33 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-eb13d2e2-8461-40b1-afb3-32319ac3d7a6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "POST /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.060207 Apr 13 22:59:33 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 109/328] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:59:33 2023] POST /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555/os-volume_attachments => generated 152 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 13 22:59:33 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-2f912ab4-213c-426b-85ea-72deffb1250e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:33 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-2f912ab4-213c-426b-85ea-72deffb1250e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2f912ab4-213c-426b-85ea-72deffb1250e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2f912ab4-213c-426b-85ea-72deffb1250e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2f912ab4-213c-426b-85ea-72deffb1250e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2f912ab4-213c-426b-85ea-72deffb1250e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2f912ab4-213c-426b-85ea-72deffb1250e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2f912ab4-213c-426b-85ea-72deffb1250e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:33 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-2f912ab4-213c-426b-85ea-72deffb1250e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "POST /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555/action" status: 202 len: 0 microversion: 2.1 time: 0.087158 Apr 13 22:59:33 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 110/329] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 22:59:33 2023] POST /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:59:33 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f0837276-7791-498b-bd9d-c25a7f195fd1 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:59:33 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f0837276-7791-498b-bd9d-c25a7f195fd1 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0837276-7791-498b-bd9d-c25a7f195fd1 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0837276-7791-498b-bd9d-c25a7f195fd1 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0837276-7791-498b-bd9d-c25a7f195fd1 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0837276-7791-498b-bd9d-c25a7f195fd1 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0837276-7791-498b-bd9d-c25a7f195fd1 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0837276-7791-498b-bd9d-c25a7f195fd1 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:34 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-f0837276-7791-498b-bd9d-c25a7f195fd1 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:59:34 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f0837276-7791-498b-bd9d-c25a7f195fd1 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555" status: 200 len: 1499 microversion: 2.1 time: 0.161271 Apr 13 22:59:34 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 111/330] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:59:33 2023] GET /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555 => generated 1499 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:59:34 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-30bb6ea3-c663-492d-8668-529325c78e56 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:59:34 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-30bb6ea3-c663-492d-8668-529325c78e56 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-30bb6ea3-c663-492d-8668-529325c78e56 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-30bb6ea3-c663-492d-8668-529325c78e56 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-30bb6ea3-c663-492d-8668-529325c78e56 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-30bb6ea3-c663-492d-8668-529325c78e56 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-30bb6ea3-c663-492d-8668-529325c78e56 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-30bb6ea3-c663-492d-8668-529325c78e56 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:34 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1458287941", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf"}], "security_groups": [{"name": "tempest-securitygroup--1704018402"}], "key_name": "tempest-keypair-286597101", "user_data": "}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:34 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-30bb6ea3-c663-492d-8668-529325c78e56 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b46af525dd45678b69207e93683ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0648ea953174a8cae6085ac24d92bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:59:34 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-30bb6ea3-c663-492d-8668-529325c78e56 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b" status: 200 len: 1639 microversion: 2.1 time: 0.172085 Apr 13 22:59:34 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 110/331] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:59:34 2023] GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b => generated 1639 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:59:34 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] validate_networks() for [('d59145a7-f00c-4cd3-ab12-f4b6ae2608cf', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:59:34 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:59:34 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:59:34 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:59:34 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:59:34 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:59:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:34 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting quotas for project 85ccac99656842aca44f9f1eb7aa167a. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:59:34 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting quotas for user 98594f3f6ccf4ffdbfd91bcf192d936e and project 85ccac99656842aca44f9f1eb7aa167a. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:59:34 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:59:34 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:59:34 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.595305 Apr 13 22:59:34 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 111/332] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:59:34 2023] POST /compute/v2.1/servers => generated 400 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:59:34 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-806d0d33-9ac6-46cf-b219-d9d1515f6467 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:59:34 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-806d0d33-9ac6-46cf-b219-d9d1515f6467 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:34 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-806d0d33-9ac6-46cf-b219-d9d1515f6467 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98594f3f6ccf4ffdbfd91bcf192d936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ccac99656842aca44f9f1eb7aa167a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:59:34 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-806d0d33-9ac6-46cf-b219-d9d1515f6467 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91" status: 200 len: 1235 microversion: 2.1 time: 0.061428 Apr 13 22:59:34 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 112/333] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:59:34 2023] GET /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91 => generated 1235 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:59:35 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-7cdc5349-db0b-4e9e-8df6-ffe4381743d6 req-c3328f2d-e6c4-4c99-8353-cccb874a53d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df12dd8d-ea02-4c59-804d-52ae1bd4a555", "name": "network-vif-unplugged", "status": "completed", "tag": "6566345e-be68-4eb1-90de-e53780e7f8f9"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7cdc5349-db0b-4e9e-8df6-ffe4381743d6 req-c3328f2d-e6c4-4c99-8353-cccb874a53d3 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7cdc5349-db0b-4e9e-8df6-ffe4381743d6 req-c3328f2d-e6c4-4c99-8353-cccb874a53d3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7cdc5349-db0b-4e9e-8df6-ffe4381743d6 req-c3328f2d-e6c4-4c99-8353-cccb874a53d3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:35 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-7cdc5349-db0b-4e9e-8df6-ffe4381743d6 req-c3328f2d-e6c4-4c99-8353-cccb874a53d3 service nova] Creating event network-vif-unplugged:6566345e-be68-4eb1-90de-e53780e7f8f9 for instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 on user Apr 13 22:59:35 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-7cdc5349-db0b-4e9e-8df6-ffe4381743d6 req-c3328f2d-e6c4-4c99-8353-cccb874a53d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031846 Apr 13 22:59:35 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 111/334] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:37 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-832b7cba-7a84-4b98-aa1b-639164e2f5da req-ab09cb65-2945-4d90-9cc7-70a7fd199e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df12dd8d-ea02-4c59-804d-52ae1bd4a555", "name": "network-vif-plugged", "status": "completed", "tag": "6566345e-be68-4eb1-90de-e53780e7f8f9"}, {"server_uuid": "df12dd8d-ea02-4c59-804d-52ae1bd4a555", "name": "network-vif-plugged", "status": "completed", "tag": "6566345e-be68-4eb1-90de-e53780e7f8f9"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-832b7cba-7a84-4b98-aa1b-639164e2f5da req-ab09cb65-2945-4d90-9cc7-70a7fd199e33 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-832b7cba-7a84-4b98-aa1b-639164e2f5da req-ab09cb65-2945-4d90-9cc7-70a7fd199e33 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-832b7cba-7a84-4b98-aa1b-639164e2f5da req-ab09cb65-2945-4d90-9cc7-70a7fd199e33 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:37 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-832b7cba-7a84-4b98-aa1b-639164e2f5da req-ab09cb65-2945-4d90-9cc7-70a7fd199e33 service nova] Creating event network-vif-plugged:6566345e-be68-4eb1-90de-e53780e7f8f9 for instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 on user Apr 13 22:59:37 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-832b7cba-7a84-4b98-aa1b-639164e2f5da req-ab09cb65-2945-4d90-9cc7-70a7fd199e33 service nova] Creating event network-vif-plugged:6566345e-be68-4eb1-90de-e53780e7f8f9 for instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 on user Apr 13 22:59:37 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-832b7cba-7a84-4b98-aa1b-639164e2f5da req-ab09cb65-2945-4d90-9cc7-70a7fd199e33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030047 Apr 13 22:59:37 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 112/335] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:37 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-0c4387d8-8e19-4f3a-a6c1-fa85260bb07c req-c0adb4ee-ea4d-49a4-ab7e-f788b6e45c7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4435b0c4-7292-4348-bcd9-a712a2df3e91", "tag": "79c62453-7ae2-480d-aa21-a5f26dfb0763"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0c4387d8-8e19-4f3a-a6c1-fa85260bb07c req-c0adb4ee-ea4d-49a4-ab7e-f788b6e45c7f service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0c4387d8-8e19-4f3a-a6c1-fa85260bb07c req-c0adb4ee-ea4d-49a4-ab7e-f788b6e45c7f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0c4387d8-8e19-4f3a-a6c1-fa85260bb07c req-c0adb4ee-ea4d-49a4-ab7e-f788b6e45c7f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:37 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-0c4387d8-8e19-4f3a-a6c1-fa85260bb07c req-c0adb4ee-ea4d-49a4-ab7e-f788b6e45c7f service nova] Creating event network-changed:79c62453-7ae2-480d-aa21-a5f26dfb0763 for instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 on user Apr 13 22:59:37 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-0c4387d8-8e19-4f3a-a6c1-fa85260bb07c req-c0adb4ee-ea4d-49a4-ab7e-f788b6e45c7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034109 Apr 13 22:59:37 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 113/336] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:39 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-8128e5d4-1164-4e83-8cda-c40ff6575fa3 req-f0a518f2-8552-4df7-9e0c-0dd623762a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df12dd8d-ea02-4c59-804d-52ae1bd4a555", "name": "network-vif-plugged", "status": "completed", "tag": "6566345e-be68-4eb1-90de-e53780e7f8f9"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-8128e5d4-1164-4e83-8cda-c40ff6575fa3 req-f0a518f2-8552-4df7-9e0c-0dd623762a17 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-8128e5d4-1164-4e83-8cda-c40ff6575fa3 req-f0a518f2-8552-4df7-9e0c-0dd623762a17 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-8128e5d4-1164-4e83-8cda-c40ff6575fa3 req-f0a518f2-8552-4df7-9e0c-0dd623762a17 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:39 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-8128e5d4-1164-4e83-8cda-c40ff6575fa3 req-f0a518f2-8552-4df7-9e0c-0dd623762a17 service nova] Creating event network-vif-plugged:6566345e-be68-4eb1-90de-e53780e7f8f9 for instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 on user Apr 13 22:59:39 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-8128e5d4-1164-4e83-8cda-c40ff6575fa3 req-f0a518f2-8552-4df7-9e0c-0dd623762a17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035236 Apr 13 22:59:39 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 112/337] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:39 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-41d81468-c8c1-4a2a-89cf-c2c73784017b req-eb2a5ed5-4b4c-4495-85d7-80aa81e711b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4435b0c4-7292-4348-bcd9-a712a2df3e91", "name": "network-vif-plugged", "status": "completed", "tag": "79c62453-7ae2-480d-aa21-a5f26dfb0763"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-41d81468-c8c1-4a2a-89cf-c2c73784017b req-eb2a5ed5-4b4c-4495-85d7-80aa81e711b3 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-41d81468-c8c1-4a2a-89cf-c2c73784017b req-eb2a5ed5-4b4c-4495-85d7-80aa81e711b3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-41d81468-c8c1-4a2a-89cf-c2c73784017b req-eb2a5ed5-4b4c-4495-85d7-80aa81e711b3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:39 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-41d81468-c8c1-4a2a-89cf-c2c73784017b req-eb2a5ed5-4b4c-4495-85d7-80aa81e711b3 service nova] Creating event network-vif-plugged:79c62453-7ae2-480d-aa21-a5f26dfb0763 for instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 on user Apr 13 22:59:39 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-41d81468-c8c1-4a2a-89cf-c2c73784017b req-eb2a5ed5-4b4c-4495-85d7-80aa81e711b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051529 Apr 13 22:59:39 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 113/338] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:41 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-5bda1ce8-6fda-476a-a7c9-d215472b1eee req-b218a870-9da1-4c5c-be46-659d3db3cbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4435b0c4-7292-4348-bcd9-a712a2df3e91", "name": "network-vif-plugged", "status": "completed", "tag": "79c62453-7ae2-480d-aa21-a5f26dfb0763"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5bda1ce8-6fda-476a-a7c9-d215472b1eee req-b218a870-9da1-4c5c-be46-659d3db3cbe0 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5bda1ce8-6fda-476a-a7c9-d215472b1eee req-b218a870-9da1-4c5c-be46-659d3db3cbe0 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5bda1ce8-6fda-476a-a7c9-d215472b1eee req-b218a870-9da1-4c5c-be46-659d3db3cbe0 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:41 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-5bda1ce8-6fda-476a-a7c9-d215472b1eee req-b218a870-9da1-4c5c-be46-659d3db3cbe0 service nova] Creating event network-vif-plugged:79c62453-7ae2-480d-aa21-a5f26dfb0763 for instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 on user Apr 13 22:59:41 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-5bda1ce8-6fda-476a-a7c9-d215472b1eee req-b218a870-9da1-4c5c-be46-659d3db3cbe0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030529 Apr 13 22:59:41 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 114/339] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:45 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:45 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:45 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-02fadf04-d340-4376-aa02-7e5b24dcfa1a req-93dadbba-5fce-4d53-a803-16cb6756f002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ec73b0-9b2a-4fc1-be85-4179075afdb8", "name": "network-vif-plugged", "status": "completed", "tag": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:45 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-02fadf04-d340-4376-aa02-7e5b24dcfa1a req-93dadbba-5fce-4d53-a803-16cb6756f002 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:45 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-02fadf04-d340-4376-aa02-7e5b24dcfa1a req-93dadbba-5fce-4d53-a803-16cb6756f002 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:45 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-02fadf04-d340-4376-aa02-7e5b24dcfa1a req-93dadbba-5fce-4d53-a803-16cb6756f002 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:45 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-02fadf04-d340-4376-aa02-7e5b24dcfa1a req-93dadbba-5fce-4d53-a803-16cb6756f002 service nova] Creating event network-vif-plugged:0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 on user Apr 13 22:59:45 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-02fadf04-d340-4376-aa02-7e5b24dcfa1a req-93dadbba-5fce-4d53-a803-16cb6756f002 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048668 Apr 13 22:59:45 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 113/340] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:46 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-ef98021c-7094-4e02-b097-d9a7bfe4fb3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:59:46 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-ef98021c-7094-4e02-b097-d9a7bfe4fb3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:46 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:46 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=12 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:46 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ef98021c-7094-4e02-b097-d9a7bfe4fb3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:46 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ef98021c-7094-4e02-b097-d9a7bfe4fb3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:46 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ef98021c-7094-4e02-b097-d9a7bfe4fb3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:46 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ef98021c-7094-4e02-b097-d9a7bfe4fb3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:46 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ef98021c-7094-4e02-b097-d9a7bfe4fb3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:46 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ef98021c-7094-4e02-b097-d9a7bfe4fb3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:46 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-ef98021c-7094-4e02-b097-d9a7bfe4fb3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:59:46 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-ef98021c-7094-4e02-b097-d9a7bfe4fb3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc51e254-7d38-49f6-816e-947d92f95950" status: 200 len: 1551 microversion: 2.1 time: 0.196938 Apr 13 22:59:46 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 114/341] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:59:46 2023] GET /compute/v2.1/servers/bc51e254-7d38-49f6-816e-947d92f95950 => generated 1551 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:59:47 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:47 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-ac2d786e-097c-49e3-9298-b7d2d2a54077 req-45e62afd-2d21-40f3-8b57-1cae63b60bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ec73b0-9b2a-4fc1-be85-4179075afdb8", "name": "network-vif-plugged", "status": "completed", "tag": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-ac2d786e-097c-49e3-9298-b7d2d2a54077 req-45e62afd-2d21-40f3-8b57-1cae63b60bf2 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-ac2d786e-097c-49e3-9298-b7d2d2a54077 req-45e62afd-2d21-40f3-8b57-1cae63b60bf2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-ac2d786e-097c-49e3-9298-b7d2d2a54077 req-45e62afd-2d21-40f3-8b57-1cae63b60bf2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:47 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-ac2d786e-097c-49e3-9298-b7d2d2a54077 req-45e62afd-2d21-40f3-8b57-1cae63b60bf2 service nova] Creating event network-vif-plugged:0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 on user Apr 13 22:59:47 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-ac2d786e-097c-49e3-9298-b7d2d2a54077 req-45e62afd-2d21-40f3-8b57-1cae63b60bf2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054346 Apr 13 22:59:47 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 115/342] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-d0cc7e4e-341a-4c57-b7e9-d0a3388468d1 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:59:48 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-d0cc7e4e-341a-4c57-b7e9-d0a3388468d1 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d0cc7e4e-341a-4c57-b7e9-d0a3388468d1 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d0cc7e4e-341a-4c57-b7e9-d0a3388468d1 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d0cc7e4e-341a-4c57-b7e9-d0a3388468d1 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d0cc7e4e-341a-4c57-b7e9-d0a3388468d1 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d0cc7e4e-341a-4c57-b7e9-d0a3388468d1 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d0cc7e4e-341a-4c57-b7e9-d0a3388468d1 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-d0cc7e4e-341a-4c57-b7e9-d0a3388468d1 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] HTTP exception thrown: Instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 could not be found. Apr 13 22:59:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-d0cc7e4e-341a-4c57-b7e9-d0a3388468d1 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Request method failure captured: Apr 13 22:59:48 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063 HTTP/1.1 Apr 13 22:59:48 user devstack@n-api.service[61612]: Accept: application/json Apr 13 22:59:48 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 22:59:48 user devstack@n-api.service[61612]: Connection: close Apr 13 22:59:48 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 22:59:48 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 22:59:48 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 22:59:48 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 22:59:48 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 22:59:48 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIfCeiGFUPfFKol5aXy6jX9sLH3vWx33vzjitaeTHf-nml7q5FZK43PuHKLvBZlgX8jSs2pa7zTc-gUNjluzyxBdSKplXrD7npwieH_pnQMw6VFqxpwPR3Mxm35AJTWEftEeO-lMs-SxQazfpmr9ETR-K47eMor60C2tGKH_ZvX_Z6Q Apr 13 22:59:48 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 22:59:48 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 22:59:48 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 22:59:48 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 22:59:48 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 22:59:48 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 22:59:48 user devstack@n-api.service[61612]: X-Project-Id: a33cf3bf67714b0ba9c7f703a1c9e5b9 Apr 13 22:59:48 user devstack@n-api.service[61612]: X-Project-Name: tempest-VolumesAdminNegativeTest-357530992 Apr 13 22:59:48 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 22:59:48 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 22:59:48 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a33cf3bf67714b0ba9c7f703a1c9e5b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a33cf3bf67714b0ba9c7f703a1c9e5b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a33cf3bf67714b0ba9c7f703a1c9e5b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 22:59:48 user devstack@n-api.service[61612]: X-Tenant: tempest-VolumesAdminNegativeTest-357530992 Apr 13 22:59:48 user devstack@n-api.service[61612]: X-Tenant-Id: a33cf3bf67714b0ba9c7f703a1c9e5b9 Apr 13 22:59:48 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-357530992 Apr 13 22:59:48 user devstack@n-api.service[61612]: X-User: tempest-VolumesAdminNegativeTest-357530992-project-member Apr 13 22:59:48 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 22:59:48 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 22:59:48 user devstack@n-api.service[61612]: X-User-Id: e1b08dea04784bc3b07195f951a84bfb Apr 13 22:59:48 user devstack@n-api.service[61612]: X-User-Name: tempest-VolumesAdminNegativeTest-357530992-project-member Apr 13 22:59:48 user devstack@n-api.service[61612]: method: > Apr 13 22:59:48 user devstack@n-api.service[61612]: exception: Instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 could not be found. Apr 13 22:59:48 user devstack@n-api.service[61612]: action_args: {'id': '2355fe9d-511a-4e7c-ac2a-5bddc034e063'} Apr 13 22:59:48 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 could not be found. Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 could not be found. Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 could not be found. Apr 13 22:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 22:59:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-d0cc7e4e-341a-4c57-b7e9-d0a3388468d1 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Returning 404 to user: Instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:59:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-d0cc7e4e-341a-4c57-b7e9-d0a3388468d1 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063" status: 404 len: 111 microversion: 2.1 time: 0.050530 Apr 13 22:59:48 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 114/343] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:59:48 2023] GET /compute/v2.1/servers/2355fe9d-511a-4e7c-ac2a-5bddc034e063 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:59:48 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-10dcdca6-958a-4adf-8f21-8e190c45cc2e tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Calling method '.version_select at 0x7f3d1df87880>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:59:48 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-10dcdca6-958a-4adf-8f21-8e190c45cc2e tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-686921666" status: 202 len: 0 microversion: 2.1 time: 0.041587 Apr 13 22:59:48 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 115/344] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 22:59:48 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-686921666 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:59:53 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-e2eb1f86-f82c-43ef-b884-b744669f58bf tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:59:53 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-e2eb1f86-f82c-43ef-b884-b744669f58bf tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e2eb1f86-f82c-43ef-b884-b744669f58bf tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e2eb1f86-f82c-43ef-b884-b744669f58bf tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e2eb1f86-f82c-43ef-b884-b744669f58bf tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e2eb1f86-f82c-43ef-b884-b744669f58bf tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e2eb1f86-f82c-43ef-b884-b744669f58bf tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e2eb1f86-f82c-43ef-b884-b744669f58bf tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:53 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-e2eb1f86-f82c-43ef-b884-b744669f58bf tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045974 Apr 13 22:59:53 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 116/345] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:59:53 2023] GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 22:59:55 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-c033053d-097e-41df-b7b9-d519c6e27ea1 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:59:55 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-c033053d-097e-41df-b7b9-d519c6e27ea1 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c033053d-097e-41df-b7b9-d519c6e27ea1 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c033053d-097e-41df-b7b9-d519c6e27ea1 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c033053d-097e-41df-b7b9-d519c6e27ea1 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c033053d-097e-41df-b7b9-d519c6e27ea1 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c033053d-097e-41df-b7b9-d519c6e27ea1 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c033053d-097e-41df-b7b9-d519c6e27ea1 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:55 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-c033053d-097e-41df-b7b9-d519c6e27ea1 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:59:55 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-c033053d-097e-41df-b7b9-d519c6e27ea1 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138" status: 200 len: 1748 microversion: 2.1 time: 0.202736 Apr 13 22:59:56 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 115/346] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:59:55 2023] GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138 => generated 1748 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 22:59:56 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-9dd144b9-7e42-4d87-8f27-82f181c4888e tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Calling method '.version_select at 0x7f3d1dd02dd0>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:59:56 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:57 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-9dd144b9-7e42-4d87-8f27-82f181c4888e tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/c843b543-e4c9-4201-984c-e4b14f1c0d99" status: 204 len: 0 microversion: 2.1 time: 0.242942 Apr 13 22:59:57 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 116/347] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:59:56 2023] DELETE /compute/v2.1/images/c843b543-e4c9-4201-984c-e4b14f1c0d99 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:59:57 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:59:57 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:57 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:59:57 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-08864850-56d6-4931-8d4f-8d09816d5396 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:59:57 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-08864850-56d6-4931-8d4f-8d09816d5396 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-08864850-56d6-4931-8d4f-8d09816d5396 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-08864850-56d6-4931-8d4f-8d09816d5396 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-08864850-56d6-4931-8d4f-8d09816d5396 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-08864850-56d6-4931-8d4f-8d09816d5396 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-08864850-56d6-4931-8d4f-8d09816d5396 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-08864850-56d6-4931-8d4f-8d09816d5396 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:57 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499" status: 204 len: 0 microversion: 2.1 time: 0.132985 Apr 13 22:59:57 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 117/348] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:59:57 2023] DELETE /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:59:57 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-3357ebb4-b200-4c32-bd25-fe1637880e7f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:59:57 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-3357ebb4-b200-4c32-bd25-fe1637880e7f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3357ebb4-b200-4c32-bd25-fe1637880e7f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3357ebb4-b200-4c32-bd25-fe1637880e7f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3357ebb4-b200-4c32-bd25-fe1637880e7f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3357ebb4-b200-4c32-bd25-fe1637880e7f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3357ebb4-b200-4c32-bd25-fe1637880e7f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3357ebb4-b200-4c32-bd25-fe1637880e7f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:57 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-08864850-56d6-4931-8d4f-8d09816d5396 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.098172 Apr 13 22:59:57 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 116/349] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 22:59:57 2023] GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a/os-interface => generated 282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 22:59:57 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-3357ebb4-b200-4c32-bd25-fe1637880e7f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03ab225421441098f94350bef24442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd502d982f4fe424a8df8149962d46963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:59:57 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-3357ebb4-b200-4c32-bd25-fe1637880e7f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499" status: 200 len: 1675 microversion: 2.1 time: 0.279481 Apr 13 22:59:57 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 117/350] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:59:57 2023] GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499 => generated 1675 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:59:57 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-5cd84573-db6d-41dc-90c0-0a51cd99ff26 req-63a4034c-f7a5-4e10-a223-ac0f73406b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f241623-e618-42eb-87d1-0606e37ec499", "name": "network-vif-unplugged", "status": "completed", "tag": "87e984d6-f653-4e7e-a230-53cd27a17d97"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5cd84573-db6d-41dc-90c0-0a51cd99ff26 req-63a4034c-f7a5-4e10-a223-ac0f73406b30 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5cd84573-db6d-41dc-90c0-0a51cd99ff26 req-63a4034c-f7a5-4e10-a223-ac0f73406b30 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5cd84573-db6d-41dc-90c0-0a51cd99ff26 req-63a4034c-f7a5-4e10-a223-ac0f73406b30 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:57 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-5cd84573-db6d-41dc-90c0-0a51cd99ff26 req-63a4034c-f7a5-4e10-a223-ac0f73406b30 service nova] Creating event network-vif-unplugged:87e984d6-f653-4e7e-a230-53cd27a17d97 for instance 3f241623-e618-42eb-87d1-0606e37ec499 on user Apr 13 22:59:57 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-5cd84573-db6d-41dc-90c0-0a51cd99ff26 req-63a4034c-f7a5-4e10-a223-ac0f73406b30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036518 Apr 13 22:59:57 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 118/351] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 22:59:58 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-3d55ac8a-0ca3-4a37-a994-9607cf327c99 req-13dea4ee-e3cc-4bbd-b0fb-ae52a23e4651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f6a020c-d8b5-4f6b-a3f0-38287111153a", "tag": "ffc806fb-1b25-492f-b786-27222f795160"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-3d55ac8a-0ca3-4a37-a994-9607cf327c99 req-13dea4ee-e3cc-4bbd-b0fb-ae52a23e4651 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-3d55ac8a-0ca3-4a37-a994-9607cf327c99 req-13dea4ee-e3cc-4bbd-b0fb-ae52a23e4651 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-3d55ac8a-0ca3-4a37-a994-9607cf327c99 req-13dea4ee-e3cc-4bbd-b0fb-ae52a23e4651 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:58 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-3d55ac8a-0ca3-4a37-a994-9607cf327c99 req-13dea4ee-e3cc-4bbd-b0fb-ae52a23e4651 service nova] Creating event network-changed:ffc806fb-1b25-492f-b786-27222f795160 for instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a on user Apr 13 22:59:58 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-3d55ac8a-0ca3-4a37-a994-9607cf327c99 req-13dea4ee-e3cc-4bbd-b0fb-ae52a23e4651 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033944 Apr 13 22:59:58 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 117/352] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:59:58 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-c258e215-b548-4cfe-9972-334e2da13725 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:59:58 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-c258e215-b548-4cfe-9972-334e2da13725 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c258e215-b548-4cfe-9972-334e2da13725 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c258e215-b548-4cfe-9972-334e2da13725 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c258e215-b548-4cfe-9972-334e2da13725 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c258e215-b548-4cfe-9972-334e2da13725 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c258e215-b548-4cfe-9972-334e2da13725 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c258e215-b548-4cfe-9972-334e2da13725 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:58 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-c258e215-b548-4cfe-9972-334e2da13725 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec0b2d09be54070ab00037165788f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b1ce9b9f4d4adf8316110aae9e04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:59:58 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-c258e215-b548-4cfe-9972-334e2da13725 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ec0b2d09be54070ab00037165788f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b1ce9b9f4d4adf8316110aae9e04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:59:58 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-c258e215-b548-4cfe-9972-334e2da13725 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ec0b2d09be54070ab00037165788f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b1ce9b9f4d4adf8316110aae9e04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:59:58 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-c258e215-b548-4cfe-9972-334e2da13725 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a" status: 200 len: 1624 microversion: 2.49 time: 0.254607 Apr 13 22:59:58 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 118/353] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:59:58 2023] GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a => generated 1624 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 22:59:58 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "10f8036f-dce2-47ad-ac84-e35492d93722", "tag": "nic-tag"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:58 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:59:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:59 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-9bf7f997-5f49-4526-b1da-e34872c28d3a req-9d4d0a52-40a8-4c24-895b-c1cb4f30ad6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f241623-e618-42eb-87d1-0606e37ec499", "name": "network-vif-plugged", "status": "completed", "tag": "87e984d6-f653-4e7e-a230-53cd27a17d97"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:59:59 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-9bf7f997-5f49-4526-b1da-e34872c28d3a req-9d4d0a52-40a8-4c24-895b-c1cb4f30ad6d service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:59:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-9bf7f997-5f49-4526-b1da-e34872c28d3a req-9d4d0a52-40a8-4c24-895b-c1cb4f30ad6d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:59:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-9bf7f997-5f49-4526-b1da-e34872c28d3a req-9d4d0a52-40a8-4c24-895b-c1cb4f30ad6d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:59:59 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=33 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:59:59 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-9bf7f997-5f49-4526-b1da-e34872c28d3a req-9d4d0a52-40a8-4c24-895b-c1cb4f30ad6d service nova] Creating event network-vif-plugged:87e984d6-f653-4e7e-a230-53cd27a17d97 for instance 3f241623-e618-42eb-87d1-0606e37ec499 on user Apr 13 22:59:59 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-9bf7f997-5f49-4526-b1da-e34872c28d3a req-9d4d0a52-40a8-4c24-895b-c1cb4f30ad6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036804 Apr 13 22:59:59 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 118/354] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:59:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:00 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-1ef9d92d-2eca-45a7-92c2-233cb9dee0c3 req-77f80e1b-3643-4ed9-bfea-a12ff254699e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f241623-e618-42eb-87d1-0606e37ec499", "name": "network-vif-deleted", "tag": "87e984d6-f653-4e7e-a230-53cd27a17d97"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:00 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:00:00 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1ef9d92d-2eca-45a7-92c2-233cb9dee0c3 req-77f80e1b-3643-4ed9-bfea-a12ff254699e service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:00 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1ef9d92d-2eca-45a7-92c2-233cb9dee0c3 req-77f80e1b-3643-4ed9-bfea-a12ff254699e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:00 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1ef9d92d-2eca-45a7-92c2-233cb9dee0c3 req-77f80e1b-3643-4ed9-bfea-a12ff254699e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:00 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-1ef9d92d-2eca-45a7-92c2-233cb9dee0c3 req-77f80e1b-3643-4ed9-bfea-a12ff254699e service nova] Creating event network-vif-deleted:87e984d6-f653-4e7e-a230-53cd27a17d97 for instance 3f241623-e618-42eb-87d1-0606e37ec499 on user Apr 13 23:00:00 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-1ef9d92d-2eca-45a7-92c2-233cb9dee0c3 req-77f80e1b-3643-4ed9-bfea-a12ff254699e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039180 Apr 13 23:00:00 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 119/355] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:02 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-55a49551-5be0-4089-a3b1-e73bbd2b9eb1 req-37828020-ebc9-4ee8-aa3c-9c57da272d56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f6a020c-d8b5-4f6b-a3f0-38287111153a", "tag": "80cfe92e-4656-4479-bb8c-4d66815c678d"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-55a49551-5be0-4089-a3b1-e73bbd2b9eb1 req-37828020-ebc9-4ee8-aa3c-9c57da272d56 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-55a49551-5be0-4089-a3b1-e73bbd2b9eb1 req-37828020-ebc9-4ee8-aa3c-9c57da272d56 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-55a49551-5be0-4089-a3b1-e73bbd2b9eb1 req-37828020-ebc9-4ee8-aa3c-9c57da272d56 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-55a49551-5be0-4089-a3b1-e73bbd2b9eb1 req-37828020-ebc9-4ee8-aa3c-9c57da272d56 service nova] Creating event network-changed:80cfe92e-4656-4479-bb8c-4d66815c678d for instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a on user Apr 13 23:00:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-55a49551-5be0-4089-a3b1-e73bbd2b9eb1 req-37828020-ebc9-4ee8-aa3c-9c57da272d56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030872 Apr 13 23:00:02 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 119/356] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:02 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-0d2e3ec8-f50f-4723-b236-7a256a430aa5 req-a905852e-1507-4a5a-b25a-1fc2ade5da2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6a020c-d8b5-4f6b-a3f0-38287111153a", "name": "network-vif-plugged", "status": "completed", "tag": "80cfe92e-4656-4479-bb8c-4d66815c678d"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0d2e3ec8-f50f-4723-b236-7a256a430aa5 req-a905852e-1507-4a5a-b25a-1fc2ade5da2e service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0d2e3ec8-f50f-4723-b236-7a256a430aa5 req-a905852e-1507-4a5a-b25a-1fc2ade5da2e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0d2e3ec8-f50f-4723-b236-7a256a430aa5 req-a905852e-1507-4a5a-b25a-1fc2ade5da2e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-0d2e3ec8-f50f-4723-b236-7a256a430aa5 req-a905852e-1507-4a5a-b25a-1fc2ade5da2e service nova] Creating event network-vif-plugged:80cfe92e-4656-4479-bb8c-4d66815c678d for instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a on user Apr 13 23:00:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-0d2e3ec8-f50f-4723-b236-7a256a430aa5 req-a905852e-1507-4a5a-b25a-1fc2ade5da2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051956 Apr 13 23:00:02 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 120/357] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:02 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:00:02 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:00:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:03 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a/os-interface" status: 200 len: 281 microversion: 2.49 time: 4.527739 Apr 13 23:00:03 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 119/358] 10.0.0.210 () {66 vars in 1414 bytes} [Thu Apr 13 22:59:58 2023] POST /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a/os-interface => generated 281 bytes in 4532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 23:00:03 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e13bf1b1-a704-41d2-980c-6ed200951f6a", "tag": "volume-tag"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:03 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:00:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:03 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.291709 Apr 13 23:00:03 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 120/359] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 23:00:03 2023] POST /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 13 23:00:04 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-14cda272-9c53-4d7b-8aa6-26c7c1f83471 req-f508d4dc-c175-4080-9903-f537de0d22c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6a020c-d8b5-4f6b-a3f0-38287111153a", "name": "network-vif-plugged", "status": "completed", "tag": "80cfe92e-4656-4479-bb8c-4d66815c678d"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-14cda272-9c53-4d7b-8aa6-26c7c1f83471 req-f508d4dc-c175-4080-9903-f537de0d22c3 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-14cda272-9c53-4d7b-8aa6-26c7c1f83471 req-f508d4dc-c175-4080-9903-f537de0d22c3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-14cda272-9c53-4d7b-8aa6-26c7c1f83471 req-f508d4dc-c175-4080-9903-f537de0d22c3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:05 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-14cda272-9c53-4d7b-8aa6-26c7c1f83471 req-f508d4dc-c175-4080-9903-f537de0d22c3 service nova] Creating event network-vif-plugged:80cfe92e-4656-4479-bb8c-4d66815c678d for instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a on user Apr 13 23:00:05 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-14cda272-9c53-4d7b-8aa6-26c7c1f83471 req-f508d4dc-c175-4080-9903-f537de0d22c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035286 Apr 13 23:00:05 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 121/360] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:11 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:11 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:00:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:11 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:00:11 user devstack@n-api.service[61611]: DEBUG nova.objects.instance [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lazy-loading 'services' on Instance uuid 3f6a020c-d8b5-4f6b-a3f0-38287111153a {{(pid=61611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:00:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a/os-volume_attachments/e13bf1b1-a704-41d2-980c-6ed200951f6a" status: 202 len: 0 microversion: 2.49 time: 0.194266 Apr 13 23:00:11 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 120/361] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 23:00:11 2023] DELETE /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a/os-volume_attachments/e13bf1b1-a704-41d2-980c-6ed200951f6a => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:00:13 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:13 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:00:13 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=5 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:00:13 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:00:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:13 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a/os-interface/80cfe92e-4656-4479-bb8c-4d66815c678d" status: 202 len: 0 microversion: 2.49 time: 0.064404 Apr 13 23:00:13 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 121/362] 10.0.0.210 () {64 vars in 1507 bytes} [Thu Apr 13 23:00:13 2023] DELETE /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a/os-interface/80cfe92e-4656-4479-bb8c-4d66815c678d => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:00:14 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-db4d1615-ca2b-4589-a4aa-062b8a2df294 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:14 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-db4d1615-ca2b-4589-a4aa-062b8a2df294 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:00:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-db4d1615-ca2b-4589-a4aa-062b8a2df294 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-db4d1615-ca2b-4589-a4aa-062b8a2df294 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-db4d1615-ca2b-4589-a4aa-062b8a2df294 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-db4d1615-ca2b-4589-a4aa-062b8a2df294 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-db4d1615-ca2b-4589-a4aa-062b8a2df294 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-db4d1615-ca2b-4589-a4aa-062b8a2df294 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:14 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-db4d1615-ca2b-4589-a4aa-062b8a2df294 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a/os-instance-actions/req-c3f2e071-8c35-4054-bd2c-d96d8b692734" status: 200 len: 474 microversion: 2.49 time: 0.247853 Apr 13 23:00:14 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 122/363] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 23:00:13 2023] GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a/os-instance-actions/req-c3f2e071-8c35-4054-bd2c-d96d8b692734 => generated 474 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 23:00:14 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-5bdf767e-fcd3-47aa-b44b-0a7b00dae38d req-334af35f-121f-46f9-986e-a0f36092f605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6a020c-d8b5-4f6b-a3f0-38287111153a", "name": "network-vif-unplugged", "status": "completed", "tag": "80cfe92e-4656-4479-bb8c-4d66815c678d"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5bdf767e-fcd3-47aa-b44b-0a7b00dae38d req-334af35f-121f-46f9-986e-a0f36092f605 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5bdf767e-fcd3-47aa-b44b-0a7b00dae38d req-334af35f-121f-46f9-986e-a0f36092f605 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5bdf767e-fcd3-47aa-b44b-0a7b00dae38d req-334af35f-121f-46f9-986e-a0f36092f605 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:14 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-5bdf767e-fcd3-47aa-b44b-0a7b00dae38d req-334af35f-121f-46f9-986e-a0f36092f605 service nova] Creating event network-vif-unplugged:80cfe92e-4656-4479-bb8c-4d66815c678d for instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a on user Apr 13 23:00:14 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-5bdf767e-fcd3-47aa-b44b-0a7b00dae38d req-334af35f-121f-46f9-986e-a0f36092f605 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048845 Apr 13 23:00:14 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 121/364] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:14 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6a020c-d8b5-4f6b-a3f0-38287111153a", "name": "network-vif-deleted", "tag": "80cfe92e-4656-4479-bb8c-4d66815c678d"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:14 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] Creating event network-vif-deleted:80cfe92e-4656-4479-bb8c-4d66815c678d for instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a on user Apr 13 23:00:14 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037816 Apr 13 23:00:14 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 122/365] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:16 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-28afdb5e-455b-4d42-8e98-95b23aac52ef req-28786f36-bf7e-4e6b-9f6c-200869a49651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6a020c-d8b5-4f6b-a3f0-38287111153a", "name": "network-vif-plugged", "status": "completed", "tag": "80cfe92e-4656-4479-bb8c-4d66815c678d"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-28afdb5e-455b-4d42-8e98-95b23aac52ef req-28786f36-bf7e-4e6b-9f6c-200869a49651 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-28afdb5e-455b-4d42-8e98-95b23aac52ef req-28786f36-bf7e-4e6b-9f6c-200869a49651 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-28afdb5e-455b-4d42-8e98-95b23aac52ef req-28786f36-bf7e-4e6b-9f6c-200869a49651 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-28afdb5e-455b-4d42-8e98-95b23aac52ef req-28786f36-bf7e-4e6b-9f6c-200869a49651 service nova] Creating event network-vif-plugged:80cfe92e-4656-4479-bb8c-4d66815c678d for instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a on user Apr 13 23:00:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-28afdb5e-455b-4d42-8e98-95b23aac52ef req-28786f36-bf7e-4e6b-9f6c-200869a49651 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031300 Apr 13 23:00:16 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 123/366] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:20 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-7b39fe2b-9aa2-4dc8-9b0c-bff302f022da tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:20 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-7b39fe2b-9aa2-4dc8-9b0c-bff302f022da tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:00:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7b39fe2b-9aa2-4dc8-9b0c-bff302f022da tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7b39fe2b-9aa2-4dc8-9b0c-bff302f022da tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7b39fe2b-9aa2-4dc8-9b0c-bff302f022da tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7b39fe2b-9aa2-4dc8-9b0c-bff302f022da tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7b39fe2b-9aa2-4dc8-9b0c-bff302f022da tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7b39fe2b-9aa2-4dc8-9b0c-bff302f022da tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:20 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-7b39fe2b-9aa2-4dc8-9b0c-bff302f022da tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:00:20 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-7b39fe2b-9aa2-4dc8-9b0c-bff302f022da tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:00:20 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-7b39fe2b-9aa2-4dc8-9b0c-bff302f022da tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:00:20 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-7b39fe2b-9aa2-4dc8-9b0c-bff302f022da tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8" status: 200 len: 1768 microversion: 2.87 time: 0.260999 Apr 13 23:00:20 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 122/367] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:00:20 2023] GET /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8 => generated 1768 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:00:23 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-fcbfd32f-eccd-437c-98fe-84cda8a1c66f tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Action: 'create', calling method: .version_select at 0x7f3d1dfb0f70>, body: {"keypair": {"name": "tempest-keypair-1127154613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg=="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:23 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-fcbfd32f-eccd-437c-98fe-84cda8a1c66f tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Getting quotas for project a3774169387c4fc59f3300af1a033087. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:00:23 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-fcbfd32f-eccd-437c-98fe-84cda8a1c66f tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Getting quotas for user c16f28e6923c4fbfbb3c295377b6f9d8 and project a3774169387c4fc59f3300af1a033087. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:00:23 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-fcbfd32f-eccd-437c-98fe-84cda8a1c66f tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.049902 Apr 13 23:00:23 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 123/368] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 23:00:23 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 23:00:24 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-84a04206-8fbd-4ad0-923f-673a6266757c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:24 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-84a04206-8fbd-4ad0-923f-673a6266757c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:00:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-84a04206-8fbd-4ad0-923f-673a6266757c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-84a04206-8fbd-4ad0-923f-673a6266757c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-84a04206-8fbd-4ad0-923f-673a6266757c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-84a04206-8fbd-4ad0-923f-673a6266757c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-84a04206-8fbd-4ad0-923f-673a6266757c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-84a04206-8fbd-4ad0-923f-673a6266757c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:24 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-84a04206-8fbd-4ad0-923f-673a6266757c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:00:24 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-84a04206-8fbd-4ad0-923f-673a6266757c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555" status: 200 len: 1505 microversion: 2.1 time: 0.163069 Apr 13 23:00:24 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 124/369] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:00:24 2023] GET /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:00:24 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-845e89ec-0075-4ac8-aa49-ecc5db90523e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:24 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-845e89ec-0075-4ac8-aa49-ecc5db90523e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:00:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-845e89ec-0075-4ac8-aa49-ecc5db90523e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-845e89ec-0075-4ac8-aa49-ecc5db90523e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-845e89ec-0075-4ac8-aa49-ecc5db90523e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-845e89ec-0075-4ac8-aa49-ecc5db90523e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-845e89ec-0075-4ac8-aa49-ecc5db90523e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-845e89ec-0075-4ac8-aa49-ecc5db90523e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:25 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-845e89ec-0075-4ac8-aa49-ecc5db90523e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98594f3f6ccf4ffdbfd91bcf192d936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ccac99656842aca44f9f1eb7aa167a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:00:25 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-845e89ec-0075-4ac8-aa49-ecc5db90523e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91" status: 200 len: 1545 microversion: 2.1 time: 0.218043 Apr 13 23:00:25 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 123/370] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:00:24 2023] GET /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91 => generated 1545 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:00:25 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=7,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:00:25 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1085018677", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "bbe00596-d1c9-459b-9276-49ccd37f3e2e"}, {"port": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "tag": "port-1"}, {"port": "5d649918-bdcb-4b16-b701-1dbad3722881", "tag": "port-2"}, {"uuid": "005f05f3-94f9-4eab-a534-b1d78fcee111", "tag": "net-1"}, {"uuid": "005f05f3-94f9-4eab-a534-b1d78fcee111"}, {"uuid": "53468967-a88c-4b4c-b3d9-26569f561a7b", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "53468967-a88c-4b4c-b3d9-26569f561a7b", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "748dfe3c-bd51-40d5-b219-46a5183d5d78", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "af258cda-4dd1-4033-92da-e5227f03ab77", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "5bc7e45c-5d77-4435-81cc-54d2f33bcd71", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--637353537"}], "key_name": "tempest-keypair-1127154613", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:25 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] validate_networks() for [('bbe00596-d1c9-459b-9276-49ccd37f3e2e', None, None, None, None, None), (None, None, '693e2c7e-e759-4e34-a3fb-ef2e51eecaca', None, None, None), (None, None, '5d649918-bdcb-4b16-b701-1dbad3722881', None, None, None), ('005f05f3-94f9-4eab-a534-b1d78fcee111', None, None, None, None, None), ('005f05f3-94f9-4eab-a534-b1d78fcee111', None, None, None, None, None), ('53468967-a88c-4b4c-b3d9-26569f561a7b', '10.2.2.100', None, None, None, None), ('53468967-a88c-4b4c-b3d9-26569f561a7b', '10.2.2.200', None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:00:27 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:00:27 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:00:27 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:00:27 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:00:27 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:00:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:27 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Getting quotas for project a3774169387c4fc59f3300af1a033087. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:00:27 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Getting quotas for user c16f28e6923c4fbfbb3c295377b6f9d8 and project a3774169387c4fc59f3300af1a033087. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:00:27 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:00:27 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='748dfe3c-bd51-40d5-b219-46a5183d5d78',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='af258cda-4dd1-4033-92da-e5227f03ab77',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5bc7e45c-5d77-4435-81cc-54d2f33bcd71',volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:00:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.32 time: 2.398275 Apr 13 23:00:27 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 124/371] 10.0.0.210 () {66 vars in 1266 bytes} [Thu Apr 13 23:00:25 2023] POST /compute/v2.1/servers => generated 403 bytes in 2400 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 23:00:27 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-a2b28c72-4a22-4f0b-b183-516c8f581d78 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:27 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-a2b28c72-4a22-4f0b-b183-516c8f581d78 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:00:27 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-a2b28c72-4a22-4f0b-b183-516c8f581d78 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16f28e6923c4fbfbb3c295377b6f9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3774169387c4fc59f3300af1a033087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:00:27 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-a2b28c72-4a22-4f0b-b183-516c8f581d78 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c16f28e6923c4fbfbb3c295377b6f9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3774169387c4fc59f3300af1a033087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:00:27 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-a2b28c72-4a22-4f0b-b183-516c8f581d78 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c16f28e6923c4fbfbb3c295377b6f9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3774169387c4fc59f3300af1a033087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:00:27 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-a2b28c72-4a22-4f0b-b183-516c8f581d78 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa" status: 200 len: 1280 microversion: 2.32 time: 0.076198 Apr 13 23:00:27 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 125/372] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:00:27 2023] GET /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:00:34 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-2b59a379-60a9-4508-818f-daa874f55bff req-cb161c91-5db4-42e9-abb5-06f2491eda8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "tag": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:34 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=12 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:00:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-2b59a379-60a9-4508-818f-daa874f55bff req-cb161c91-5db4-42e9-abb5-06f2491eda8d service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-2b59a379-60a9-4508-818f-daa874f55bff req-cb161c91-5db4-42e9-abb5-06f2491eda8d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-2b59a379-60a9-4508-818f-daa874f55bff req-cb161c91-5db4-42e9-abb5-06f2491eda8d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:34 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-2b59a379-60a9-4508-818f-daa874f55bff req-cb161c91-5db4-42e9-abb5-06f2491eda8d service nova] Creating event network-changed:302fbc22-4c9a-48dc-bf40-4aec87dd4b92 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:34 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-2b59a379-60a9-4508-818f-daa874f55bff req-cb161c91-5db4-42e9-abb5-06f2491eda8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032415 Apr 13 23:00:34 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 124/373] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:34 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:34 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Going to try to start instance {{(pid=61612) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 13 23:00:34 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "POST /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b/action" status: 202 len: 0 microversion: 2.1 time: 0.075569 Apr 13 23:00:34 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 125/374] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 23:00:34 2023] POST /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 23:00:34 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-bdd1fb2e-82c6-4716-b345-8f51c97e4db3 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:34 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-bdd1fb2e-82c6-4716-b345-8f51c97e4db3 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:00:34 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=34 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:00:34 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=16 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:00:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bdd1fb2e-82c6-4716-b345-8f51c97e4db3 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bdd1fb2e-82c6-4716-b345-8f51c97e4db3 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bdd1fb2e-82c6-4716-b345-8f51c97e4db3 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bdd1fb2e-82c6-4716-b345-8f51c97e4db3 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bdd1fb2e-82c6-4716-b345-8f51c97e4db3 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bdd1fb2e-82c6-4716-b345-8f51c97e4db3 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:34 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-bdd1fb2e-82c6-4716-b345-8f51c97e4db3 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b46af525dd45678b69207e93683ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0648ea953174a8cae6085ac24d92bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:00:34 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-bdd1fb2e-82c6-4716-b345-8f51c97e4db3 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b" status: 200 len: 1648 microversion: 2.1 time: 0.160356 Apr 13 23:00:34 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 126/375] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:00:34 2023] GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b => generated 1648 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:00:36 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "tag": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca"}, {"name": "network-changed", "server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "tag": "5d649918-bdcb-4b16-b701-1dbad3722881"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:36 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:36 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:36 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:36 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] Creating event network-changed:693e2c7e-e759-4e34-a3fb-ef2e51eecaca for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:36 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] Creating event network-changed:5d649918-bdcb-4b16-b701-1dbad3722881 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:36 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.031452 Apr 13 23:00:36 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 125/376] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:36 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 23:00:37 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:00:37 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=10 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:00:37 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-61076a12-1420-4461-974a-0ef80f0b9278 req-ce1c38cc-906f-47e4-a40b-22b0be818b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e1fa88-8896-4198-af4d-56d44baf3b9b", "name": "network-vif-plugged", "status": "completed", "tag": "94c47f47-2ee7-46d0-858d-a5ff3270a80b"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-61076a12-1420-4461-974a-0ef80f0b9278 req-ce1c38cc-906f-47e4-a40b-22b0be818b6f service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-61076a12-1420-4461-974a-0ef80f0b9278 req-ce1c38cc-906f-47e4-a40b-22b0be818b6f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-61076a12-1420-4461-974a-0ef80f0b9278 req-ce1c38cc-906f-47e4-a40b-22b0be818b6f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:37 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-61076a12-1420-4461-974a-0ef80f0b9278 req-ce1c38cc-906f-47e4-a40b-22b0be818b6f service nova] Creating event network-vif-plugged:94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b on user Apr 13 23:00:37 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-61076a12-1420-4461-974a-0ef80f0b9278 req-ce1c38cc-906f-47e4-a40b-22b0be818b6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059477 Apr 13 23:00:37 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 126/377] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:38 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-22d6f9f6-94d5-4f53-91db-2a99febea7ba req-b587551e-da59-4a90-b4d2-767b28797cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "tag": "d7199650-e2d2-4349-af5f-357b9f511835"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:38 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:00:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-22d6f9f6-94d5-4f53-91db-2a99febea7ba req-b587551e-da59-4a90-b4d2-767b28797cda service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-22d6f9f6-94d5-4f53-91db-2a99febea7ba req-b587551e-da59-4a90-b4d2-767b28797cda service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-22d6f9f6-94d5-4f53-91db-2a99febea7ba req-b587551e-da59-4a90-b4d2-767b28797cda service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:38 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-22d6f9f6-94d5-4f53-91db-2a99febea7ba req-b587551e-da59-4a90-b4d2-767b28797cda service nova] Creating event network-changed:d7199650-e2d2-4349-af5f-357b9f511835 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:38 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-22d6f9f6-94d5-4f53-91db-2a99febea7ba req-b587551e-da59-4a90-b4d2-767b28797cda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038043 Apr 13 23:00:38 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 127/378] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:39 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-7dc22af8-b4ac-4582-9b5e-9b7d6e5a70cd req-426ef58a-c7c2-4e3a-b56c-9e13de749ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e1fa88-8896-4198-af4d-56d44baf3b9b", "name": "network-vif-plugged", "status": "completed", "tag": "94c47f47-2ee7-46d0-858d-a5ff3270a80b"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-7dc22af8-b4ac-4582-9b5e-9b7d6e5a70cd req-426ef58a-c7c2-4e3a-b56c-9e13de749ddc service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-7dc22af8-b4ac-4582-9b5e-9b7d6e5a70cd req-426ef58a-c7c2-4e3a-b56c-9e13de749ddc service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-7dc22af8-b4ac-4582-9b5e-9b7d6e5a70cd req-426ef58a-c7c2-4e3a-b56c-9e13de749ddc service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:39 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-7dc22af8-b4ac-4582-9b5e-9b7d6e5a70cd req-426ef58a-c7c2-4e3a-b56c-9e13de749ddc service nova] Creating event network-vif-plugged:94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b on user Apr 13 23:00:39 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-7dc22af8-b4ac-4582-9b5e-9b7d6e5a70cd req-426ef58a-c7c2-4e3a-b56c-9e13de749ddc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030115 Apr 13 23:00:39 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 126/379] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:40 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "tag": "7e8b103f-6a1d-41f9-aab0-8c17817026a5"}, {"name": "network-changed", "server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "tag": "b5c60c56-d874-48fe-be4f-5dd41322809f"}, {"name": "network-changed", "server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "tag": "20766522-a6dc-49b0-a925-09cbcce46937"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:40 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:40 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:40 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:40 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] Creating event network-changed:7e8b103f-6a1d-41f9-aab0-8c17817026a5 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:40 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] Creating event network-changed:b5c60c56-d874-48fe-be4f-5dd41322809f for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:40 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] Creating event network-changed:20766522-a6dc-49b0-a925-09cbcce46937 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:40 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.045266 Apr 13 23:00:40 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 127/380] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:40 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:47 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8103cba1-0dfc-44c6-b483-ac92723cef6b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:47 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-8103cba1-0dfc-44c6-b483-ac92723cef6b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:00:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8103cba1-0dfc-44c6-b483-ac92723cef6b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8103cba1-0dfc-44c6-b483-ac92723cef6b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8103cba1-0dfc-44c6-b483-ac92723cef6b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8103cba1-0dfc-44c6-b483-ac92723cef6b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8103cba1-0dfc-44c6-b483-ac92723cef6b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8103cba1-0dfc-44c6-b483-ac92723cef6b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:47 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-8103cba1-0dfc-44c6-b483-ac92723cef6b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:00:47 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-8103cba1-0dfc-44c6-b483-ac92723cef6b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc51e254-7d38-49f6-816e-947d92f95950" status: 200 len: 1551 microversion: 2.1 time: 0.165206 Apr 13 23:00:47 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 128/381] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:00:46 2023] GET /compute/v2.1/servers/bc51e254-7d38-49f6-816e-947d92f95950 => generated 1551 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:00:47 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:47 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:00:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:47 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:00:47 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:00:47 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bc51e254-7d38-49f6-816e-947d92f95950" status: 204 len: 0 microversion: 2.1 time: 0.114880 Apr 13 23:00:47 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 127/382] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:00:47 2023] DELETE /compute/v2.1/servers/bc51e254-7d38-49f6-816e-947d92f95950 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:00:47 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-dfd8ccbf-d5bd-4720-ae4c-13852e3f77be tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:47 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-dfd8ccbf-d5bd-4720-ae4c-13852e3f77be tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:00:47 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:00:47 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dfd8ccbf-d5bd-4720-ae4c-13852e3f77be tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:47 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dfd8ccbf-d5bd-4720-ae4c-13852e3f77be tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:47 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dfd8ccbf-d5bd-4720-ae4c-13852e3f77be tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:47 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dfd8ccbf-d5bd-4720-ae4c-13852e3f77be tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:47 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dfd8ccbf-d5bd-4720-ae4c-13852e3f77be tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:47 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dfd8ccbf-d5bd-4720-ae4c-13852e3f77be tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:47 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-dfd8ccbf-d5bd-4720-ae4c-13852e3f77be tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:00:47 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-a1a3a545-56cc-4834-80eb-5918c5f33372 req-e60eaf4b-cd87-4e27-be94-0653e0c59d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc51e254-7d38-49f6-816e-947d92f95950", "name": "network-vif-unplugged", "status": "completed", "tag": "b06270a1-7c20-4d1a-98b7-4dafc26585e2"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:47 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-dfd8ccbf-d5bd-4720-ae4c-13852e3f77be tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc51e254-7d38-49f6-816e-947d92f95950" status: 200 len: 1557 microversion: 2.1 time: 0.209275 Apr 13 23:00:47 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 128/383] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:00:47 2023] GET /compute/v2.1/servers/bc51e254-7d38-49f6-816e-947d92f95950 => generated 1557 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:00:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a1a3a545-56cc-4834-80eb-5918c5f33372 req-e60eaf4b-cd87-4e27-be94-0653e0c59d8d service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a1a3a545-56cc-4834-80eb-5918c5f33372 req-e60eaf4b-cd87-4e27-be94-0653e0c59d8d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a1a3a545-56cc-4834-80eb-5918c5f33372 req-e60eaf4b-cd87-4e27-be94-0653e0c59d8d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:47 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-a1a3a545-56cc-4834-80eb-5918c5f33372 req-e60eaf4b-cd87-4e27-be94-0653e0c59d8d service nova] Creating event network-vif-unplugged:b06270a1-7c20-4d1a-98b7-4dafc26585e2 for instance bc51e254-7d38-49f6-816e-947d92f95950 on user Apr 13 23:00:47 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-a1a3a545-56cc-4834-80eb-5918c5f33372 req-e60eaf4b-cd87-4e27-be94-0653e0c59d8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039743 Apr 13 23:00:47 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 129/384] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:47 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f74f88fa-dc8b-48b8-859f-3bc90b5b2a82 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:47 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f74f88fa-dc8b-48b8-859f-3bc90b5b2a82 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:00:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f74f88fa-dc8b-48b8-859f-3bc90b5b2a82 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f74f88fa-dc8b-48b8-859f-3bc90b5b2a82 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f74f88fa-dc8b-48b8-859f-3bc90b5b2a82 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f74f88fa-dc8b-48b8-859f-3bc90b5b2a82 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f74f88fa-dc8b-48b8-859f-3bc90b5b2a82 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f74f88fa-dc8b-48b8-859f-3bc90b5b2a82 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:47 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-f74f88fa-dc8b-48b8-859f-3bc90b5b2a82 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] HTTP exception thrown: Instance 3f241623-e618-42eb-87d1-0606e37ec499 could not be found. Apr 13 23:00:47 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f74f88fa-dc8b-48b8-859f-3bc90b5b2a82 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Request method failure captured: Apr 13 23:00:47 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499 HTTP/1.1 Apr 13 23:00:47 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:00:47 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:00:47 user devstack@n-api.service[61611]: Connection: close Apr 13 23:00:47 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:00:47 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:00:47 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:00:47 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:00:47 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:00:47 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIezhLOd9y7cerGINsD-3dtjCEQRG3Uu2PLRqKC9OCT3JKzwW_gUkJbomAieSwjk-9OJUTBexYexLyX_CBPR17lnpilo6_5OINoklT8YZBBgi76AwQAvAZtZST4q1Rq8HhK3qQiUwpgYtDdV6xhLJPBwIoZeNRrr2GHl3fEngTxwqig Apr 13 23:00:47 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:00:47 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:00:47 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:00:47 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:00:47 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:00:47 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:00:47 user devstack@n-api.service[61611]: X-Project-Id: d502d982f4fe424a8df8149962d46963 Apr 13 23:00:47 user devstack@n-api.service[61611]: X-Project-Name: tempest-ServerStableDeviceRescueTest-149870328 Apr 13 23:00:47 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:00:47 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:00:47 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d502d982f4fe424a8df8149962d46963"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d502d982f4fe424a8df8149962d46963"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d502d982f4fe424a8df8149962d46963"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:00:47 user devstack@n-api.service[61611]: X-Tenant: tempest-ServerStableDeviceRescueTest-149870328 Apr 13 23:00:47 user devstack@n-api.service[61611]: X-Tenant-Id: d502d982f4fe424a8df8149962d46963 Apr 13 23:00:47 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-149870328 Apr 13 23:00:47 user devstack@n-api.service[61611]: X-User: tempest-ServerStableDeviceRescueTest-149870328-project-member Apr 13 23:00:47 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:00:47 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:00:47 user devstack@n-api.service[61611]: X-User-Id: 3f03ab225421441098f94350bef24442 Apr 13 23:00:47 user devstack@n-api.service[61611]: X-User-Name: tempest-ServerStableDeviceRescueTest-149870328-project-member Apr 13 23:00:47 user devstack@n-api.service[61611]: method: > Apr 13 23:00:47 user devstack@n-api.service[61611]: exception: Instance 3f241623-e618-42eb-87d1-0606e37ec499 could not be found. Apr 13 23:00:47 user devstack@n-api.service[61611]: action_args: {'id': '3f241623-e618-42eb-87d1-0606e37ec499'} Apr 13 23:00:47 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f241623-e618-42eb-87d1-0606e37ec499 could not be found. Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f241623-e618-42eb-87d1-0606e37ec499 could not be found. Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f241623-e618-42eb-87d1-0606e37ec499 could not be found. Apr 13 23:00:47 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:00:47 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f74f88fa-dc8b-48b8-859f-3bc90b5b2a82 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Returning 404 to user: Instance 3f241623-e618-42eb-87d1-0606e37ec499 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:00:47 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f74f88fa-dc8b-48b8-859f-3bc90b5b2a82 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499" status: 404 len: 111 microversion: 2.1 time: 0.037918 Apr 13 23:00:47 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 128/385] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:00:47 2023] GET /compute/v2.1/servers/3f241623-e618-42eb-87d1-0606e37ec499 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:00:47 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-bb5b1f84-f37c-4f41-af85-f44fa2cde3a9 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Calling method '.version_select at 0x7f3d1df36d40>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:47 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-bb5b1f84-f37c-4f41-af85-f44fa2cde3a9 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1726987531" status: 202 len: 0 microversion: 2.1 time: 0.025948 Apr 13 23:00:47 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 129/386] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 23:00:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1726987531 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 23:00:49 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-63b7ff98-9ef6-48fb-bfb4-97d53a958b9e req-c7f304fe-ebdf-4ff4-b70a-0f56e34150e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc51e254-7d38-49f6-816e-947d92f95950", "name": "network-vif-plugged", "status": "completed", "tag": "b06270a1-7c20-4d1a-98b7-4dafc26585e2"}, {"server_uuid": "bc51e254-7d38-49f6-816e-947d92f95950", "name": "network-vif-deleted", "tag": "b06270a1-7c20-4d1a-98b7-4dafc26585e2"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-63b7ff98-9ef6-48fb-bfb4-97d53a958b9e req-c7f304fe-ebdf-4ff4-b70a-0f56e34150e1 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-63b7ff98-9ef6-48fb-bfb4-97d53a958b9e req-c7f304fe-ebdf-4ff4-b70a-0f56e34150e1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-63b7ff98-9ef6-48fb-bfb4-97d53a958b9e req-c7f304fe-ebdf-4ff4-b70a-0f56e34150e1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:49 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-63b7ff98-9ef6-48fb-bfb4-97d53a958b9e req-c7f304fe-ebdf-4ff4-b70a-0f56e34150e1 service nova] Creating event network-vif-plugged:b06270a1-7c20-4d1a-98b7-4dafc26585e2 for instance bc51e254-7d38-49f6-816e-947d92f95950 on user Apr 13 23:00:49 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-63b7ff98-9ef6-48fb-bfb4-97d53a958b9e req-c7f304fe-ebdf-4ff4-b70a-0f56e34150e1 service nova] Creating event network-vif-deleted:b06270a1-7c20-4d1a-98b7-4dafc26585e2 for instance bc51e254-7d38-49f6-816e-947d92f95950 on user Apr 13 23:00:49 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-63b7ff98-9ef6-48fb-bfb4-97d53a958b9e req-c7f304fe-ebdf-4ff4-b70a-0f56e34150e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056893 Apr 13 23:00:49 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 130/387] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:50 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-616b9a87-cb20-45e3-9eae-0d2e531b2f35 req-cbf80165-3f52-46ea-85c9-b9be0442888b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-616b9a87-cb20-45e3-9eae-0d2e531b2f35 req-cbf80165-3f52-46ea-85c9-b9be0442888b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-616b9a87-cb20-45e3-9eae-0d2e531b2f35 req-cbf80165-3f52-46ea-85c9-b9be0442888b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-616b9a87-cb20-45e3-9eae-0d2e531b2f35 req-cbf80165-3f52-46ea-85c9-b9be0442888b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:50 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-616b9a87-cb20-45e3-9eae-0d2e531b2f35 req-cbf80165-3f52-46ea-85c9-b9be0442888b service nova] Creating event network-vif-plugged:302fbc22-4c9a-48dc-bf40-4aec87dd4b92 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:50 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-616b9a87-cb20-45e3-9eae-0d2e531b2f35 req-cbf80165-3f52-46ea-85c9-b9be0442888b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064986 Apr 13 23:00:50 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 129/388] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:50 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-4d40823c-fcc1-4752-b069-8a837c2ae5b9 req-ad957eb2-2668-4773-99c2-d42c36eb3405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-4d40823c-fcc1-4752-b069-8a837c2ae5b9 req-ad957eb2-2668-4773-99c2-d42c36eb3405 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-4d40823c-fcc1-4752-b069-8a837c2ae5b9 req-ad957eb2-2668-4773-99c2-d42c36eb3405 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-4d40823c-fcc1-4752-b069-8a837c2ae5b9 req-ad957eb2-2668-4773-99c2-d42c36eb3405 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:50 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-4d40823c-fcc1-4752-b069-8a837c2ae5b9 req-ad957eb2-2668-4773-99c2-d42c36eb3405 service nova] Creating event network-vif-plugged:693e2c7e-e759-4e34-a3fb-ef2e51eecaca for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:50 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-4d40823c-fcc1-4752-b069-8a837c2ae5b9 req-ad957eb2-2668-4773-99c2-d42c36eb3405 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032675 Apr 13 23:00:50 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 130/389] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:51 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-2fa60efb-6367-4644-9759-fb3bd5b723aa req-b5eca620-f3dd-4269-a384-d4d9802195ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "5d649918-bdcb-4b16-b701-1dbad3722881"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2fa60efb-6367-4644-9759-fb3bd5b723aa req-b5eca620-f3dd-4269-a384-d4d9802195ea service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2fa60efb-6367-4644-9759-fb3bd5b723aa req-b5eca620-f3dd-4269-a384-d4d9802195ea service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2fa60efb-6367-4644-9759-fb3bd5b723aa req-b5eca620-f3dd-4269-a384-d4d9802195ea service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:51 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-2fa60efb-6367-4644-9759-fb3bd5b723aa req-b5eca620-f3dd-4269-a384-d4d9802195ea service nova] Creating event network-vif-plugged:5d649918-bdcb-4b16-b701-1dbad3722881 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:51 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-2fa60efb-6367-4644-9759-fb3bd5b723aa req-b5eca620-f3dd-4269-a384-d4d9802195ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034829 Apr 13 23:00:51 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 131/390] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:52 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92"}, {"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "7e8b103f-6a1d-41f9-aab0-8c17817026a5"}, {"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "7e8b103f-6a1d-41f9-aab0-8c17817026a5"}, {"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "b5c60c56-d874-48fe-be4f-5dd41322809f"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:52 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] Creating event network-vif-plugged:302fbc22-4c9a-48dc-bf40-4aec87dd4b92 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:52 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] Creating event network-vif-plugged:7e8b103f-6a1d-41f9-aab0-8c17817026a5 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:52 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] Creating event network-vif-plugged:7e8b103f-6a1d-41f9-aab0-8c17817026a5 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:52 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] Creating event network-vif-plugged:b5c60c56-d874-48fe-be4f-5dd41322809f for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:52 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.042736 Apr 13 23:00:52 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 130/391] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:52 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:52 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca"}, {"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "d7199650-e2d2-4349-af5f-357b9f511835"}, {"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "d7199650-e2d2-4349-af5f-357b9f511835"}, {"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "20766522-a6dc-49b0-a925-09cbcce46937"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:52 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] Creating event network-vif-plugged:693e2c7e-e759-4e34-a3fb-ef2e51eecaca for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:52 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] Creating event network-vif-plugged:d7199650-e2d2-4349-af5f-357b9f511835 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:52 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] Creating event network-vif-plugged:d7199650-e2d2-4349-af5f-357b9f511835 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:52 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] Creating event network-vif-plugged:20766522-a6dc-49b0-a925-09cbcce46937 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:52 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.045532 Apr 13 23:00:52 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 131/392] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:52 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:53 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-adee46c5-f17f-4d6d-8049-2d5229ff0e03 req-79a09406-0982-4cbc-ae7e-21facd664fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "5d649918-bdcb-4b16-b701-1dbad3722881"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-adee46c5-f17f-4d6d-8049-2d5229ff0e03 req-79a09406-0982-4cbc-ae7e-21facd664fd4 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-adee46c5-f17f-4d6d-8049-2d5229ff0e03 req-79a09406-0982-4cbc-ae7e-21facd664fd4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-adee46c5-f17f-4d6d-8049-2d5229ff0e03 req-79a09406-0982-4cbc-ae7e-21facd664fd4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:53 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-adee46c5-f17f-4d6d-8049-2d5229ff0e03 req-79a09406-0982-4cbc-ae7e-21facd664fd4 service nova] Creating event network-vif-plugged:5d649918-bdcb-4b16-b701-1dbad3722881 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:53 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-adee46c5-f17f-4d6d-8049-2d5229ff0e03 req-79a09406-0982-4cbc-ae7e-21facd664fd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042795 Apr 13 23:00:53 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 132/393] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:54 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-36655244-bb20-4214-b768-e09075b6965a req-8f29977a-2ccf-403f-a99f-131b8d1b1f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "b5c60c56-d874-48fe-be4f-5dd41322809f"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-36655244-bb20-4214-b768-e09075b6965a req-8f29977a-2ccf-403f-a99f-131b8d1b1f8b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-36655244-bb20-4214-b768-e09075b6965a req-8f29977a-2ccf-403f-a99f-131b8d1b1f8b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-36655244-bb20-4214-b768-e09075b6965a req-8f29977a-2ccf-403f-a99f-131b8d1b1f8b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:54 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-36655244-bb20-4214-b768-e09075b6965a req-8f29977a-2ccf-403f-a99f-131b8d1b1f8b service nova] Creating event network-vif-plugged:b5c60c56-d874-48fe-be4f-5dd41322809f for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:54 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-36655244-bb20-4214-b768-e09075b6965a req-8f29977a-2ccf-403f-a99f-131b8d1b1f8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033605 Apr 13 23:00:54 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 131/394] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:54 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-25d5bdd2-ac95-4b88-94b6-47df1b0358fb req-133edf98-d16c-427f-86e5-0f9270f7a2d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "20766522-a6dc-49b0-a925-09cbcce46937"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-25d5bdd2-ac95-4b88-94b6-47df1b0358fb req-133edf98-d16c-427f-86e5-0f9270f7a2d9 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-25d5bdd2-ac95-4b88-94b6-47df1b0358fb req-133edf98-d16c-427f-86e5-0f9270f7a2d9 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-25d5bdd2-ac95-4b88-94b6-47df1b0358fb req-133edf98-d16c-427f-86e5-0f9270f7a2d9 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:54 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-25d5bdd2-ac95-4b88-94b6-47df1b0358fb req-133edf98-d16c-427f-86e5-0f9270f7a2d9 service nova] Creating event network-vif-plugged:20766522-a6dc-49b0-a925-09cbcce46937 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:00:54 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-25d5bdd2-ac95-4b88-94b6-47df1b0358fb req-133edf98-d16c-427f-86e5-0f9270f7a2d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035626 Apr 13 23:00:54 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 133/395] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:54 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-150ccade-7732-4bd2-b2b1-eaeadd8862ca tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Action: 'create', calling method: .version_select at 0x7f3d1de94dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1075853027"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:55 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-150ccade-7732-4bd2-b2b1-eaeadd8862ca tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.566231 Apr 13 23:00:55 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 132/396] 10.0.0.210 () {64 vars in 1232 bytes} [Thu Apr 13 23:00:54 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 568 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 13 23:00:55 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5c1bf432-0e25-4162-a3ab-e88d9e49740f tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Calling method '.version_select at 0x7f3d1e0bf1c0>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:55 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-5c1bf432-0e25-4162-a3ab-e88d9e49740f tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877" status: 200 len: 345 microversion: 2.1 time: 0.062835 Apr 13 23:00:55 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 132/397] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 23:00:55 2023] GET /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:56 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-baff159a-7bec-43f4-840e-a9f08e89ed7b tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Calling method '.version_select at 0x7f3d1de748b0>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:56 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-baff159a-7bec-43f4-840e-a9f08e89ed7b tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877" status: 200 len: 346 microversion: 2.1 time: 0.063479 Apr 13 23:00:56 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 134/398] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 23:00:56 2023] GET /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877 => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:56 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-3818da4d-85e7-466f-9ae4-718c0c0a5a6e tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Action: 'create', calling method: .version_select at 0x7f3d1dfb20e0>, body: {"snapshot": {"volume_id": "3bd0b3d2-612f-49be-afbf-980ba7866877", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1776715892"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:56 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-eaa250ee-ca23-4959-97f4-f87bd4a44f1b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1854904717"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:56 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-eaa250ee-ca23-4959-97f4-f87bd4a44f1b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:00:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-eaa250ee-ca23-4959-97f4-f87bd4a44f1b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-eaa250ee-ca23-4959-97f4-f87bd4a44f1b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-eaa250ee-ca23-4959-97f4-f87bd4a44f1b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-eaa250ee-ca23-4959-97f4-f87bd4a44f1b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-eaa250ee-ca23-4959-97f4-f87bd4a44f1b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-eaa250ee-ca23-4959-97f4-f87bd4a44f1b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:56 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-3818da4d-85e7-466f-9ae4-718c0c0a5a6e tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.232177 Apr 13 23:00:56 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 133/399] 10.0.0.210 () {64 vars in 1239 bytes} [Thu Apr 13 23:00:56 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:56 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-cc687703-e8e4-4ca3-b315-0b5878612702 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Calling method '.version_select at 0x7f3d1dc62dd0>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:56 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-cc687703-e8e4-4ca3-b315-0b5878612702 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/9321319a-f378-4521-b65c-167e9bab0c69" status: 200 len: 287 microversion: 2.1 time: 0.042971 Apr 13 23:00:56 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 135/400] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 23:00:56 2023] GET /compute/v2.1/os-snapshots/9321319a-f378-4521-b65c-167e9bab0c69 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:56 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-caa6834a-f1a8-4618-bcc1-16fe944702b4 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Calling method '.version_select at 0x7f3d1de96c20>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:56 user devstack@n-api.service[61611]: INFO nova.network.security_group_api [None req-eaa250ee-ca23-4959-97f4-f87bd4a44f1b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Removing security group c4ec2504-93fe-4c05-8923-148e032f3b1b from port 37865aaf-d7fb-4f6b-b764-2b75e9d3e924 Apr 13 23:00:56 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-caa6834a-f1a8-4618-bcc1-16fe944702b4 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.044504 Apr 13 23:00:56 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 134/401] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 13 23:00:56 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:56 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-9d255ec1-8753-4571-85d6-e493469bd739 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Calling method '.version_select at 0x7f3d1dc61ea0>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:56 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-9d255ec1-8753-4571-85d6-e493469bd739 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/9321319a-f378-4521-b65c-167e9bab0c69" status: 200 len: 287 microversion: 2.1 time: 0.042415 Apr 13 23:00:56 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 136/402] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 23:00:56 2023] GET /compute/v2.1/os-snapshots/9321319a-f378-4521-b65c-167e9bab0c69 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:57 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-eaa250ee-ca23-4959-97f4-f87bd4a44f1b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138/action" status: 202 len: 0 microversion: 2.1 time: 0.664086 Apr 13 23:00:57 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 133/403] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 23:00:56 2023] POST /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138/action => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:00:57 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-a01cea87-0a08-4ce9-b559-2b92c2767aa1 req-cc1377bd-7d91-41e5-88f5-bbd0d6602918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b190941d-9f62-41ef-881d-e02d246e9138", "tag": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a01cea87-0a08-4ce9-b559-2b92c2767aa1 req-cc1377bd-7d91-41e5-88f5-bbd0d6602918 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a01cea87-0a08-4ce9-b559-2b92c2767aa1 req-cc1377bd-7d91-41e5-88f5-bbd0d6602918 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a01cea87-0a08-4ce9-b559-2b92c2767aa1 req-cc1377bd-7d91-41e5-88f5-bbd0d6602918 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:57 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:00:57 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-a01cea87-0a08-4ce9-b559-2b92c2767aa1 req-cc1377bd-7d91-41e5-88f5-bbd0d6602918 service nova] Creating event network-changed:37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance b190941d-9f62-41ef-881d-e02d246e9138 on user Apr 13 23:00:57 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-a01cea87-0a08-4ce9-b559-2b92c2767aa1 req-cc1377bd-7d91-41e5-88f5-bbd0d6602918 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032800 Apr 13 23:00:57 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 135/404] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:57 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-b1c3d12a-7513-4168-960b-38c01bde5dd6 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Calling method '.version_select at 0x7f3d1dc61e10>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:57 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-b1c3d12a-7513-4168-960b-38c01bde5dd6 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/9321319a-f378-4521-b65c-167e9bab0c69" status: 200 len: 287 microversion: 2.1 time: 0.071999 Apr 13 23:00:57 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 137/405] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 23:00:57 2023] GET /compute/v2.1/os-snapshots/9321319a-f378-4521-b65c-167e9bab0c69 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:57 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-6f829846-34fd-4aca-875f-ef8f28441fbc req-c5cb2be9-54ac-4491-8b1a-6039ff986b6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b190941d-9f62-41ef-881d-e02d246e9138", "tag": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:00:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-6f829846-34fd-4aca-875f-ef8f28441fbc req-c5cb2be9-54ac-4491-8b1a-6039ff986b6a service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-6f829846-34fd-4aca-875f-ef8f28441fbc req-c5cb2be9-54ac-4491-8b1a-6039ff986b6a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-6f829846-34fd-4aca-875f-ef8f28441fbc req-c5cb2be9-54ac-4491-8b1a-6039ff986b6a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:57 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-6f829846-34fd-4aca-875f-ef8f28441fbc req-c5cb2be9-54ac-4491-8b1a-6039ff986b6a service nova] Creating event network-changed:37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance b190941d-9f62-41ef-881d-e02d246e9138 on user Apr 13 23:00:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-6f829846-34fd-4aca-875f-ef8f28441fbc req-c5cb2be9-54ac-4491-8b1a-6039ff986b6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038475 Apr 13 23:00:58 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 134/406] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:00:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:58 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:58 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:00:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:58 user devstack@n-api.service[61612]: DEBUG nova.objects.instance [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lazy-loading 'services' on Instance uuid b190941d-9f62-41ef-881d-e02d246e9138 {{(pid=61612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:00:58 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138/os-volume_attachments/31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c" status: 202 len: 0 microversion: 2.1 time: 0.178702 Apr 13 23:00:58 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 136/407] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 23:00:58 2023] DELETE /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138/os-volume_attachments/31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 23:00:58 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-a303a41d-1516-462d-beb5-0bacd4031148 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:58 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-a303a41d-1516-462d-beb5-0bacd4031148 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:00:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a303a41d-1516-462d-beb5-0bacd4031148 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a303a41d-1516-462d-beb5-0bacd4031148 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a303a41d-1516-462d-beb5-0bacd4031148 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a303a41d-1516-462d-beb5-0bacd4031148 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:00:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a303a41d-1516-462d-beb5-0bacd4031148 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:00:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a303a41d-1516-462d-beb5-0bacd4031148 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:00:58 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-a303a41d-1516-462d-beb5-0bacd4031148 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057226 Apr 13 23:00:58 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 138/408] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:00:58 2023] GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:58 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d23d4404-5285-427c-8ad5-806d52224d65 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Calling method '.version_select at 0x7f3d1dfd3250>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-d23d4404-5285-427c-8ad5-806d52224d65 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/9321319a-f378-4521-b65c-167e9bab0c69" status: 200 len: 288 microversion: 2.1 time: 0.036942 Apr 13 23:00:58 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 135/409] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 23:00:58 2023] GET /compute/v2.1/os-snapshots/9321319a-f378-4521-b65c-167e9bab0c69 => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:58 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-16416a4c-e1cb-4a04-ae18-e6b70eb9039f tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Calling method '.version_select at 0x7f3d1de96830>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:58 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-16416a4c-e1cb-4a04-ae18-e6b70eb9039f tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/9321319a-f378-4521-b65c-167e9bab0c69" status: 202 len: 0 microversion: 2.1 time: 0.069689 Apr 13 23:00:58 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 137/410] 10.0.0.210 () {62 vars in 1331 bytes} [Thu Apr 13 23:00:58 2023] DELETE /compute/v2.1/os-snapshots/9321319a-f378-4521-b65c-167e9bab0c69 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:00:58 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-65dcadaa-c9c9-4ea4-91f9-ee4d4582a35f tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Calling method '.version_select at 0x7f3d1dc604c0>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:58 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-65dcadaa-c9c9-4ea4-91f9-ee4d4582a35f tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/9321319a-f378-4521-b65c-167e9bab0c69" status: 200 len: 287 microversion: 2.1 time: 0.040401 Apr 13 23:00:58 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 139/411] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 23:00:58 2023] GET /compute/v2.1/os-snapshots/9321319a-f378-4521-b65c-167e9bab0c69 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:00:59 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-97d5b9bc-0ca4-4681-9778-27ade9872ddc tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Calling method '.version_select at 0x7f3d1c506c20>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:00:59 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-97d5b9bc-0ca4-4681-9778-27ade9872ddc tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/9321319a-f378-4521-b65c-167e9bab0c69" status: 200 len: 287 microversion: 2.1 time: 0.041143 Apr 13 23:00:59 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 136/412] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 23:00:59 2023] GET /compute/v2.1/os-snapshots/9321319a-f378-4521-b65c-167e9bab0c69 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:00 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-2ee04b4e-7dee-4064-a7bb-de941fcfc55c tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Calling method '.version_select at 0x7f3d1e05b520>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:01 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-2ee04b4e-7dee-4064-a7bb-de941fcfc55c tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] HTTP exception thrown: Snapshot 9321319a-f378-4521-b65c-167e9bab0c69 could not be found. Apr 13 23:01:01 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-2ee04b4e-7dee-4064-a7bb-de941fcfc55c tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Request method failure captured: Apr 13 23:01:01 user devstack@n-api.service[61612]: request: GET /compute/v2.1/os-snapshots/9321319a-f378-4521-b65c-167e9bab0c69 HTTP/1.1 Apr 13 23:01:01 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:01:01 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:01:01 user devstack@n-api.service[61612]: Connection: close Apr 13 23:01:01 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:01:01 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:01:01 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:01:01 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:01:01 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:01:01 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOImmYZzG_99nYs5ZDL8wFmMmGPANTVTW1SNe3VNuiac_K8JYTwxBXsydeqVlKfz8FL-oKVyZqwKe_rKmI9CdXWtlqVRXPUnlL5lqcvl8aBxdeK_OXTNXUTnuVgqUk59QYHv5hFAcRR5W0xvwLKuGQ9zm6DDn156Fd4zl7R-cUtou__M Apr 13 23:01:01 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:01:01 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:01:01 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:01:01 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:01:01 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:01:01 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:01:01 user devstack@n-api.service[61612]: X-Project-Id: cd01a62a4b724218bbe3a8a8101b3e12 Apr 13 23:01:01 user devstack@n-api.service[61612]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2093412325 Apr 13 23:01:01 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:01:01 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:01:01 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cd01a62a4b724218bbe3a8a8101b3e12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cd01a62a4b724218bbe3a8a8101b3e12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cd01a62a4b724218bbe3a8a8101b3e12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:01:01 user devstack@n-api.service[61612]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2093412325 Apr 13 23:01:01 user devstack@n-api.service[61612]: X-Tenant-Id: cd01a62a4b724218bbe3a8a8101b3e12 Apr 13 23:01:01 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2093412325 Apr 13 23:01:01 user devstack@n-api.service[61612]: X-User: tempest-VolumesSnapshotsTestJSON-2093412325-project-member Apr 13 23:01:01 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:01:01 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:01:01 user devstack@n-api.service[61612]: X-User-Id: 20e44f05d26b4861b341446ded6858d1 Apr 13 23:01:01 user devstack@n-api.service[61612]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2093412325-project-member Apr 13 23:01:01 user devstack@n-api.service[61612]: method: Apr 13 23:01:01 user devstack@n-api.service[61612]: exception: Snapshot 9321319a-f378-4521-b65c-167e9bab0c69 could not be found. Apr 13 23:01:01 user devstack@n-api.service[61612]: action_args: {'id': '9321319a-f378-4521-b65c-167e9bab0c69'} Apr 13 23:01:01 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9321319a-f378-4521-b65c-167e9bab0c69 could not be found. (HTTP 404) (Request-ID: req-73a94167-6b28-4fcd-afab-511e42b3d8e0) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9321319a-f378-4521-b65c-167e9bab0c69 could not be found. Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9321319a-f378-4521-b65c-167e9bab0c69 could not be found. Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9321319a-f378-4521-b65c-167e9bab0c69 could not be found. Apr 13 23:01:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:01:01 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-2ee04b4e-7dee-4064-a7bb-de941fcfc55c tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Returning 404 to user: Snapshot 9321319a-f378-4521-b65c-167e9bab0c69 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:01:01 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-2ee04b4e-7dee-4064-a7bb-de941fcfc55c tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/9321319a-f378-4521-b65c-167e9bab0c69" status: 404 len: 111 microversion: 2.1 time: 0.033196 Apr 13 23:01:01 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 138/413] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 23:01:00 2023] GET /compute/v2.1/os-snapshots/9321319a-f378-4521-b65c-167e9bab0c69 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:01:01 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-888d5f83-ccd2-43b4-a932-e50fcec57f4d tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Calling method '.version_select at 0x7f3d1dc62680>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:01 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-888d5f83-ccd2-43b4-a932-e50fcec57f4d tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877" status: 202 len: 0 microversion: 2.1 time: 0.076152 Apr 13 23:01:01 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 140/414] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 23:01:01 2023] DELETE /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:01:01 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-a38e0003-2b38-4de2-8e7d-8cd3df52f0f2 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Calling method '.version_select at 0x7f3d1c5055a0>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:01 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-a38e0003-2b38-4de2-8e7d-8cd3df52f0f2 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877" status: 200 len: 345 microversion: 2.1 time: 0.055606 Apr 13 23:01:01 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 137/415] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 23:01:01 2023] GET /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:02 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-bb969725-5fee-435b-a207-8526b65ce860 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Calling method '.version_select at 0x7f3d1dfb32e0>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-bb969725-5fee-435b-a207-8526b65ce860 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877" status: 200 len: 345 microversion: 2.1 time: 0.070231 Apr 13 23:01:02 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 139/416] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 23:01:02 2023] GET /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877 => generated 345 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:03 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-1a08f76f-e5f4-44d5-9991-01694b1acf70 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Calling method '.version_select at 0x7f3d1dc61d80>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:03 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-1a08f76f-e5f4-44d5-9991-01694b1acf70 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877" status: 200 len: 345 microversion: 2.1 time: 0.054143 Apr 13 23:01:03 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 141/417] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 23:01:03 2023] GET /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-bf371351-7717-4cf8-bbfb-f8d084bf8d26 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-bf371351-7717-4cf8-bbfb-f8d084bf8d26 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bf371351-7717-4cf8-bbfb-f8d084bf8d26 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bf371351-7717-4cf8-bbfb-f8d084bf8d26 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bf371351-7717-4cf8-bbfb-f8d084bf8d26 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bf371351-7717-4cf8-bbfb-f8d084bf8d26 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bf371351-7717-4cf8-bbfb-f8d084bf8d26 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bf371351-7717-4cf8-bbfb-f8d084bf8d26 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:04 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-bf371351-7717-4cf8-bbfb-f8d084bf8d26 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a/os-instance-actions/req-c3f2e071-8c35-4054-bd2c-d96d8b692734" status: 200 len: 503 microversion: 2.49 time: 0.094891 Apr 13 23:01:04 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 138/418] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 23:01:04 2023] GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a/os-instance-actions/req-c3f2e071-8c35-4054-bd2c-d96d8b692734 => generated 503 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-8e5e0346-7465-46bc-96ee-bacfa140a5d0 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-8e5e0346-7465-46bc-96ee-bacfa140a5d0 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8e5e0346-7465-46bc-96ee-bacfa140a5d0 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8e5e0346-7465-46bc-96ee-bacfa140a5d0 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8e5e0346-7465-46bc-96ee-bacfa140a5d0 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8e5e0346-7465-46bc-96ee-bacfa140a5d0 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8e5e0346-7465-46bc-96ee-bacfa140a5d0 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8e5e0346-7465-46bc-96ee-bacfa140a5d0 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:04 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-8e5e0346-7465-46bc-96ee-bacfa140a5d0 tempest-TaggedAttachmentsTest-1957460974 tempest-TaggedAttachmentsTest-1957460974-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a/os-instance-actions/req-c3f2e071-8c35-4054-bd2c-d96d8b692734" status: 200 len: 503 microversion: 2.49 time: 0.094723 Apr 13 23:01:04 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 140/419] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 23:01:04 2023] GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a/os-instance-actions/req-c3f2e071-8c35-4054-bd2c-d96d8b692734 => generated 503 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 23:01:04 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-f3d47ccb-6f64-408b-8759-e9b109886cf8 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Calling method '.version_select at 0x7f3d1dcf0160>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:04 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-f3d47ccb-6f64-408b-8759-e9b109886cf8 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] HTTP exception thrown: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. Apr 13 23:01:04 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-f3d47ccb-6f64-408b-8759-e9b109886cf8 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Request method failure captured: Apr 13 23:01:04 user devstack@n-api.service[61613]: request: GET /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877 HTTP/1.1 Apr 13 23:01:04 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:01:04 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:01:04 user devstack@n-api.service[61613]: Connection: close Apr 13 23:01:04 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:01:04 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:01:04 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:01:04 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:01:04 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOImmYZzG_99nYs5ZDL8wFmMmGPANTVTW1SNe3VNuiac_K8JYTwxBXsydeqVlKfz8FL-oKVyZqwKe_rKmI9CdXWtlqVRXPUnlL5lqcvl8aBxdeK_OXTNXUTnuVgqUk59QYHv5hFAcRR5W0xvwLKuGQ9zm6DDn156Fd4zl7R-cUtou__M Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Project-Id: cd01a62a4b724218bbe3a8a8101b3e12 Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2093412325 Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cd01a62a4b724218bbe3a8a8101b3e12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cd01a62a4b724218bbe3a8a8101b3e12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cd01a62a4b724218bbe3a8a8101b3e12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2093412325 Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Tenant-Id: cd01a62a4b724218bbe3a8a8101b3e12 Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2093412325 Apr 13 23:01:04 user devstack@n-api.service[61613]: X-User: tempest-VolumesSnapshotsTestJSON-2093412325-project-member Apr 13 23:01:04 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:01:04 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:01:04 user devstack@n-api.service[61613]: X-User-Id: 20e44f05d26b4861b341446ded6858d1 Apr 13 23:01:04 user devstack@n-api.service[61613]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2093412325-project-member Apr 13 23:01:04 user devstack@n-api.service[61613]: method: Apr 13 23:01:04 user devstack@n-api.service[61613]: exception: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. Apr 13 23:01:04 user devstack@n-api.service[61613]: action_args: {'id': '3bd0b3d2-612f-49be-afbf-980ba7866877'} Apr 13 23:01:04 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. (HTTP 404) (Request-ID: req-0deddb23-41ba-429e-97e6-da8e2830f61d) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-f3d47ccb-6f64-408b-8759-e9b109886cf8 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Returning 404 to user: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:01:04 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-f3d47ccb-6f64-408b-8759-e9b109886cf8 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877" status: 404 len: 109 microversion: 2.1 time: 0.034781 Apr 13 23:01:04 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 142/420] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 23:01:04 2023] GET /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-38ad59c3-5683-4753-adc2-ca8d0c51099c tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Calling method '.version_select at 0x7f3d1dfd29e0>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-4784acf8-270d-4361-b278-55ddd36a68cc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-4784acf8-270d-4361-b278-55ddd36a68cc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:04 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-38ad59c3-5683-4753-adc2-ca8d0c51099c tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] HTTP exception thrown: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4784acf8-270d-4361-b278-55ddd36a68cc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-38ad59c3-5683-4753-adc2-ca8d0c51099c tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Request method failure captured: Apr 13 23:01:04 user devstack@n-api.service[61611]: request: DELETE /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877 HTTP/1.1 Apr 13 23:01:04 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:01:04 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:01:04 user devstack@n-api.service[61611]: Connection: close Apr 13 23:01:04 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:01:04 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:01:04 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:01:04 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:01:04 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:01:04 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOImmYZzG_99nYs5ZDL8wFmMmGPANTVTW1SNe3VNuiac_K8JYTwxBXsydeqVlKfz8FL-oKVyZqwKe_rKmI9CdXWtlqVRXPUnlL5lqcvl8aBxdeK_OXTNXUTnuVgqUk59QYHv5hFAcRR5W0xvwLKuGQ9zm6DDn156Fd4zl7R-cUtou__M Apr 13 23:01:04 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:01:04 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:01:04 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:01:04 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:01:04 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:01:04 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:01:04 user devstack@n-api.service[61611]: X-Project-Id: cd01a62a4b724218bbe3a8a8101b3e12 Apr 13 23:01:04 user devstack@n-api.service[61611]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2093412325 Apr 13 23:01:04 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:01:04 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:01:04 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cd01a62a4b724218bbe3a8a8101b3e12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cd01a62a4b724218bbe3a8a8101b3e12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cd01a62a4b724218bbe3a8a8101b3e12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:01:04 user devstack@n-api.service[61611]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2093412325 Apr 13 23:01:04 user devstack@n-api.service[61611]: X-Tenant-Id: cd01a62a4b724218bbe3a8a8101b3e12 Apr 13 23:01:04 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2093412325 Apr 13 23:01:04 user devstack@n-api.service[61611]: X-User: tempest-VolumesSnapshotsTestJSON-2093412325-project-member Apr 13 23:01:04 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:01:04 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:01:04 user devstack@n-api.service[61611]: X-User-Id: 20e44f05d26b4861b341446ded6858d1 Apr 13 23:01:04 user devstack@n-api.service[61611]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2093412325-project-member Apr 13 23:01:04 user devstack@n-api.service[61611]: method: Apr 13 23:01:04 user devstack@n-api.service[61611]: exception: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. Apr 13 23:01:04 user devstack@n-api.service[61611]: action_args: {'id': '3bd0b3d2-612f-49be-afbf-980ba7866877'} Apr 13 23:01:04 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. (HTTP 404) (Request-ID: req-342a91fc-0895-4d00-9bee-b1617e607d32) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. Apr 13 23:01:04 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4784acf8-270d-4361-b278-55ddd36a68cc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-38ad59c3-5683-4753-adc2-ca8d0c51099c tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Returning 404 to user: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4784acf8-270d-4361-b278-55ddd36a68cc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:04 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-38ad59c3-5683-4753-adc2-ca8d0c51099c tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877" status: 404 len: 109 microversion: 2.1 time: 0.036451 Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4784acf8-270d-4361-b278-55ddd36a68cc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:04 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 139/421] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 23:01:04 2023] DELETE /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4784acf8-270d-4361-b278-55ddd36a68cc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4784acf8-270d-4361-b278-55ddd36a68cc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:04 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-27832095-a9bc-4008-b09d-17acdb4f8419 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Calling method '.version_select at 0x7f3d1dc600d0>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:04 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-4784acf8-270d-4361-b278-55ddd36a68cc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.045938 Apr 13 23:01:04 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 141/422] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 23:01:04 2023] GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:01:04 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-27832095-a9bc-4008-b09d-17acdb4f8419 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] HTTP exception thrown: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. Apr 13 23:01:04 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-27832095-a9bc-4008-b09d-17acdb4f8419 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Request method failure captured: Apr 13 23:01:04 user devstack@n-api.service[61613]: request: GET /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877 HTTP/1.1 Apr 13 23:01:04 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:01:04 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:01:04 user devstack@n-api.service[61613]: Connection: close Apr 13 23:01:04 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:01:04 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:01:04 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:01:04 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:01:04 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOImmYZzG_99nYs5ZDL8wFmMmGPANTVTW1SNe3VNuiac_K8JYTwxBXsydeqVlKfz8FL-oKVyZqwKe_rKmI9CdXWtlqVRXPUnlL5lqcvl8aBxdeK_OXTNXUTnuVgqUk59QYHv5hFAcRR5W0xvwLKuGQ9zm6DDn156Fd4zl7R-cUtou__M Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Project-Id: cd01a62a4b724218bbe3a8a8101b3e12 Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2093412325 Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cd01a62a4b724218bbe3a8a8101b3e12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cd01a62a4b724218bbe3a8a8101b3e12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cd01a62a4b724218bbe3a8a8101b3e12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2093412325 Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Tenant-Id: cd01a62a4b724218bbe3a8a8101b3e12 Apr 13 23:01:04 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2093412325 Apr 13 23:01:04 user devstack@n-api.service[61613]: X-User: tempest-VolumesSnapshotsTestJSON-2093412325-project-member Apr 13 23:01:04 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:01:04 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:01:04 user devstack@n-api.service[61613]: X-User-Id: 20e44f05d26b4861b341446ded6858d1 Apr 13 23:01:04 user devstack@n-api.service[61613]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2093412325-project-member Apr 13 23:01:04 user devstack@n-api.service[61613]: method: Apr 13 23:01:04 user devstack@n-api.service[61613]: exception: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. Apr 13 23:01:04 user devstack@n-api.service[61613]: action_args: {'id': '3bd0b3d2-612f-49be-afbf-980ba7866877'} Apr 13 23:01:04 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. (HTTP 404) (Request-ID: req-373e1b6d-65e0-45f5-8c9b-1295da44f22d) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. Apr 13 23:01:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:04 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-27832095-a9bc-4008-b09d-17acdb4f8419 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] Returning 404 to user: Volume 3bd0b3d2-612f-49be-afbf-980ba7866877 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:01:04 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-27832095-a9bc-4008-b09d-17acdb4f8419 tempest-VolumesSnapshotsTestJSON-2093412325 tempest-VolumesSnapshotsTestJSON-2093412325-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877" status: 404 len: 109 microversion: 2.1 time: 0.033519 Apr 13 23:01:04 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 143/423] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 23:01:04 2023] GET /compute/v2.1/os-volumes/3bd0b3d2-612f-49be-afbf-980ba7866877 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:04 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:01:04 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a" status: 204 len: 0 microversion: 2.49 time: 0.196833 Apr 13 23:01:04 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 140/424] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 23:01:04 2023] DELETE /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-2cb195be-e15a-4fbf-952c-c2f80752ee9f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-2cb195be-e15a-4fbf-952c-c2f80752ee9f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2cb195be-e15a-4fbf-952c-c2f80752ee9f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2cb195be-e15a-4fbf-952c-c2f80752ee9f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2cb195be-e15a-4fbf-952c-c2f80752ee9f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2cb195be-e15a-4fbf-952c-c2f80752ee9f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2cb195be-e15a-4fbf-952c-c2f80752ee9f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2cb195be-e15a-4fbf-952c-c2f80752ee9f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-2cb195be-e15a-4fbf-952c-c2f80752ee9f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec0b2d09be54070ab00037165788f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b1ce9b9f4d4adf8316110aae9e04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:01:04 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-7ea9aba8-ec99-4531-895c-d33ee94a7b5e req-fc8b9368-86a3-4903-8359-9df694a6494b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6a020c-d8b5-4f6b-a3f0-38287111153a", "name": "network-vif-unplugged", "status": "completed", "tag": "ffc806fb-1b25-492f-b786-27222f795160"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-2cb195be-e15a-4fbf-952c-c2f80752ee9f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ec0b2d09be54070ab00037165788f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b1ce9b9f4d4adf8316110aae9e04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:01:04 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=18 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:01:04 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-2cb195be-e15a-4fbf-952c-c2f80752ee9f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ec0b2d09be54070ab00037165788f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b1ce9b9f4d4adf8316110aae9e04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:01:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-7ea9aba8-ec99-4531-895c-d33ee94a7b5e req-fc8b9368-86a3-4903-8359-9df694a6494b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-7ea9aba8-ec99-4531-895c-d33ee94a7b5e req-fc8b9368-86a3-4903-8359-9df694a6494b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:04 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-2cb195be-e15a-4fbf-952c-c2f80752ee9f tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a" status: 200 len: 1749 microversion: 2.49 time: 0.300122 Apr 13 23:01:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-7ea9aba8-ec99-4531-895c-d33ee94a7b5e req-fc8b9368-86a3-4903-8359-9df694a6494b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:04 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 142/425] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:01:04 2023] GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a => generated 1749 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:01:05 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=31 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:01:05 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-7ea9aba8-ec99-4531-895c-d33ee94a7b5e req-fc8b9368-86a3-4903-8359-9df694a6494b service nova] Creating event network-vif-unplugged:ffc806fb-1b25-492f-b786-27222f795160 for instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a on user Apr 13 23:01:05 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-7ea9aba8-ec99-4531-895c-d33ee94a7b5e req-fc8b9368-86a3-4903-8359-9df694a6494b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036036 Apr 13 23:01:05 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 144/426] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:01:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:07 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-362789bb-2e57-4639-abfe-b51b8565931e req-4f6d7fac-300f-4527-92d3-b42563e28f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6a020c-d8b5-4f6b-a3f0-38287111153a", "name": "network-vif-plugged", "status": "completed", "tag": "ffc806fb-1b25-492f-b786-27222f795160"}, {"server_uuid": "3f6a020c-d8b5-4f6b-a3f0-38287111153a", "name": "network-vif-deleted", "tag": "ffc806fb-1b25-492f-b786-27222f795160"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-362789bb-2e57-4639-abfe-b51b8565931e req-4f6d7fac-300f-4527-92d3-b42563e28f99 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-362789bb-2e57-4639-abfe-b51b8565931e req-4f6d7fac-300f-4527-92d3-b42563e28f99 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-362789bb-2e57-4639-abfe-b51b8565931e req-4f6d7fac-300f-4527-92d3-b42563e28f99 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:07 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-362789bb-2e57-4639-abfe-b51b8565931e req-4f6d7fac-300f-4527-92d3-b42563e28f99 service nova] Creating event network-vif-plugged:ffc806fb-1b25-492f-b786-27222f795160 for instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a on user Apr 13 23:01:07 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-362789bb-2e57-4639-abfe-b51b8565931e req-4f6d7fac-300f-4527-92d3-b42563e28f99 service nova] Creating event network-vif-deleted:ffc806fb-1b25-492f-b786-27222f795160 for instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a on user Apr 13 23:01:07 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-362789bb-2e57-4639-abfe-b51b8565931e req-4f6d7fac-300f-4527-92d3-b42563e28f99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037569 Apr 13 23:01:07 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 141/427] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:01:07 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-c2167741-080b-4ff8-86a7-1f5dcaf85b24 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:17 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-c2167741-080b-4ff8-86a7-1f5dcaf85b24 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:17 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:01:17 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:01:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c2167741-080b-4ff8-86a7-1f5dcaf85b24 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c2167741-080b-4ff8-86a7-1f5dcaf85b24 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c2167741-080b-4ff8-86a7-1f5dcaf85b24 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c2167741-080b-4ff8-86a7-1f5dcaf85b24 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c2167741-080b-4ff8-86a7-1f5dcaf85b24 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c2167741-080b-4ff8-86a7-1f5dcaf85b24 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:18 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-c2167741-080b-4ff8-86a7-1f5dcaf85b24 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16f28e6923c4fbfbb3c295377b6f9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3774169387c4fc59f3300af1a033087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:01:18 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-c2167741-080b-4ff8-86a7-1f5dcaf85b24 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c16f28e6923c4fbfbb3c295377b6f9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3774169387c4fc59f3300af1a033087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:01:18 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-c2167741-080b-4ff8-86a7-1f5dcaf85b24 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c16f28e6923c4fbfbb3c295377b6f9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3774169387c4fc59f3300af1a033087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:01:18 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-c2167741-080b-4ff8-86a7-1f5dcaf85b24 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa" status: 200 len: 2821 microversion: 2.32 time: 0.286308 Apr 13 23:01:18 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 143/428] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:01:17 2023] GET /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa => generated 2821 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:01:18 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:01:18 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:01:18 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-940156379", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:18 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] validate_networks() for None {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:01:18 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:01:18 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:01:18 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:01:18 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:01:18 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:01:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:18 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Getting quotas for project ea52ea14393449b3b0ce5a8ed973e435. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:01:18 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Getting quotas for user 6eea00459cc046129decc442a6996ee0 and project ea52ea14393449b3b0ce5a8ed973e435. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:01:18 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:01:18 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:01:18 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.414003 Apr 13 23:01:18 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 145/429] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:01:18 2023] POST /compute/v2.1/servers => generated 378 bytes in 416 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:01:18 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:01:18 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:01:18 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-da04aab4-3b7b-48b7-a64d-4cccf77a7574 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:18 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-da04aab4-3b7b-48b7-a64d-4cccf77a7574 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:18 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-da04aab4-3b7b-48b7-a64d-4cccf77a7574 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eea00459cc046129decc442a6996ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea52ea14393449b3b0ce5a8ed973e435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:01:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-da04aab4-3b7b-48b7-a64d-4cccf77a7574 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2979e2c-7ef9-4cbd-8daf-dedd5103f857" status: 200 len: 1208 microversion: 2.1 time: 0.077271 Apr 13 23:01:18 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 142/430] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:01:18 2023] GET /compute/v2.1/servers/a2979e2c-7ef9-4cbd-8daf-dedd5103f857 => generated 1208 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:01:20 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "1883aa58-f5b6-4162-a531-94bd4fdc1547"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:20 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:21 user devstack@n-api.service[61612]: DEBUG nova.objects.instance [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'flavor' on Instance uuid 31ec73b0-9b2a-4fc1-be85-4179075afdb8 {{(pid=61612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:01:21 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "POST /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8/action" status: 200 len: 29 microversion: 2.87 time: 0.512151 Apr 13 23:01:21 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 144/431] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 23:01:20 2023] POST /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8/action => generated 29 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:01:21 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5f786f3c-9533-4865-8c18-52bc99c37636 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:21 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-5f786f3c-9533-4865-8c18-52bc99c37636 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5f786f3c-9533-4865-8c18-52bc99c37636 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5f786f3c-9533-4865-8c18-52bc99c37636 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5f786f3c-9533-4865-8c18-52bc99c37636 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5f786f3c-9533-4865-8c18-52bc99c37636 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5f786f3c-9533-4865-8c18-52bc99c37636 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5f786f3c-9533-4865-8c18-52bc99c37636 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:21 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-5f786f3c-9533-4865-8c18-52bc99c37636 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:01:21 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-5f786f3c-9533-4865-8c18-52bc99c37636 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:01:21 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-5f786f3c-9533-4865-8c18-52bc99c37636 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:01:21 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-5f786f3c-9533-4865-8c18-52bc99c37636 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8" status: 200 len: 1774 microversion: 2.87 time: 0.158222 Apr 13 23:01:21 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 146/432] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:01:21 2023] GET /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8 => generated 1774 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:01:21 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-c3f4f086-bffe-46a4-ba5c-98e971ae08e5 req-2c0ecee9-3c0e-4d77-9942-963e3ce9c7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2979e2c-7ef9-4cbd-8daf-dedd5103f857", "tag": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-c3f4f086-bffe-46a4-ba5c-98e971ae08e5 req-2c0ecee9-3c0e-4d77-9942-963e3ce9c7b3 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-c3f4f086-bffe-46a4-ba5c-98e971ae08e5 req-2c0ecee9-3c0e-4d77-9942-963e3ce9c7b3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-c3f4f086-bffe-46a4-ba5c-98e971ae08e5 req-2c0ecee9-3c0e-4d77-9942-963e3ce9c7b3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:21 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-c3f4f086-bffe-46a4-ba5c-98e971ae08e5 req-2c0ecee9-3c0e-4d77-9942-963e3ce9c7b3 service nova] Creating event network-changed:5f5f289c-7a04-41f3-b5e8-73e45d3ac536 for instance a2979e2c-7ef9-4cbd-8daf-dedd5103f857 on user Apr 13 23:01:21 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-c3f4f086-bffe-46a4-ba5c-98e971ae08e5 req-2c0ecee9-3c0e-4d77-9942-963e3ce9c7b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055744 Apr 13 23:01:21 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 143/433] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:01:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:22 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-7f6fc8a0-56ce-4e8f-bcdc-56eab54dbeae req-e8a74705-cea6-4a0e-bccf-af64992d965b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ec73b0-9b2a-4fc1-be85-4179075afdb8", "name": "network-vif-unplugged", "status": "completed", "tag": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7f6fc8a0-56ce-4e8f-bcdc-56eab54dbeae req-e8a74705-cea6-4a0e-bccf-af64992d965b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7f6fc8a0-56ce-4e8f-bcdc-56eab54dbeae req-e8a74705-cea6-4a0e-bccf-af64992d965b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7f6fc8a0-56ce-4e8f-bcdc-56eab54dbeae req-e8a74705-cea6-4a0e-bccf-af64992d965b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:22 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-7f6fc8a0-56ce-4e8f-bcdc-56eab54dbeae req-e8a74705-cea6-4a0e-bccf-af64992d965b service nova] Creating event network-vif-unplugged:0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 on user Apr 13 23:01:22 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-7f6fc8a0-56ce-4e8f-bcdc-56eab54dbeae req-e8a74705-cea6-4a0e-bccf-af64992d965b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032604 Apr 13 23:01:22 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 145/434] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:01:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:24 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-6a5b7133-6226-4fa5-ab06-0681ab3c4b68 req-e501d630-9448-463a-9b8f-bcf940ffbd95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2979e2c-7ef9-4cbd-8daf-dedd5103f857", "name": "network-vif-plugged", "status": "completed", "tag": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6a5b7133-6226-4fa5-ab06-0681ab3c4b68 req-e501d630-9448-463a-9b8f-bcf940ffbd95 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6a5b7133-6226-4fa5-ab06-0681ab3c4b68 req-e501d630-9448-463a-9b8f-bcf940ffbd95 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6a5b7133-6226-4fa5-ab06-0681ab3c4b68 req-e501d630-9448-463a-9b8f-bcf940ffbd95 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:24 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-6a5b7133-6226-4fa5-ab06-0681ab3c4b68 req-e501d630-9448-463a-9b8f-bcf940ffbd95 service nova] Creating event network-vif-plugged:5f5f289c-7a04-41f3-b5e8-73e45d3ac536 for instance a2979e2c-7ef9-4cbd-8daf-dedd5103f857 on user Apr 13 23:01:24 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-6a5b7133-6226-4fa5-ab06-0681ab3c4b68 req-e501d630-9448-463a-9b8f-bcf940ffbd95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030056 Apr 13 23:01:24 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 147/435] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:01:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:24 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-48b84e57-d25c-439f-a72e-e7d063df44fa req-4fa4ee73-2e1a-4d86-9afb-bb72a18582e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ec73b0-9b2a-4fc1-be85-4179075afdb8", "name": "network-vif-plugged", "status": "completed", "tag": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:24 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-9fe6f021-528b-4274-a1b0-b421cd597ef9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:24 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-9fe6f021-528b-4274-a1b0-b421cd597ef9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-48b84e57-d25c-439f-a72e-e7d063df44fa req-4fa4ee73-2e1a-4d86-9afb-bb72a18582e9 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-48b84e57-d25c-439f-a72e-e7d063df44fa req-4fa4ee73-2e1a-4d86-9afb-bb72a18582e9 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-48b84e57-d25c-439f-a72e-e7d063df44fa req-4fa4ee73-2e1a-4d86-9afb-bb72a18582e9 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9fe6f021-528b-4274-a1b0-b421cd597ef9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9fe6f021-528b-4274-a1b0-b421cd597ef9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9fe6f021-528b-4274-a1b0-b421cd597ef9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9fe6f021-528b-4274-a1b0-b421cd597ef9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9fe6f021-528b-4274-a1b0-b421cd597ef9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9fe6f021-528b-4274-a1b0-b421cd597ef9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:24 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-48b84e57-d25c-439f-a72e-e7d063df44fa req-4fa4ee73-2e1a-4d86-9afb-bb72a18582e9 service nova] Creating event network-vif-plugged:0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 on user Apr 13 23:01:24 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-48b84e57-d25c-439f-a72e-e7d063df44fa req-4fa4ee73-2e1a-4d86-9afb-bb72a18582e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222574 Apr 13 23:01:24 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 144/436] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:01:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:24 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-9fe6f021-528b-4274-a1b0-b421cd597ef9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b46af525dd45678b69207e93683ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0648ea953174a8cae6085ac24d92bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:01:24 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-9fe6f021-528b-4274-a1b0-b421cd597ef9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b" status: 200 len: 1652 microversion: 2.1 time: 0.173775 Apr 13 23:01:24 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 146/437] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:01:24 2023] GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b => generated 1652 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:01:25 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8e95e2cc-ab77-4297-968a-daac3e176ccb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:25 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-8e95e2cc-ab77-4297-968a-daac3e176ccb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8e95e2cc-ab77-4297-968a-daac3e176ccb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8e95e2cc-ab77-4297-968a-daac3e176ccb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8e95e2cc-ab77-4297-968a-daac3e176ccb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8e95e2cc-ab77-4297-968a-daac3e176ccb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8e95e2cc-ab77-4297-968a-daac3e176ccb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8e95e2cc-ab77-4297-968a-daac3e176ccb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:25 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-8e95e2cc-ab77-4297-968a-daac3e176ccb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.089133 Apr 13 23:01:25 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 148/438] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 23:01:25 2023] GET /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91/os-interface => generated 282 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:26 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-76224d49-53c8-423e-9ead-c2cf16078371 req-0b904acd-7400-476b-9d85-677f960b90b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4435b0c4-7292-4348-bcd9-a712a2df3e91", "tag": "79c62453-7ae2-480d-aa21-a5f26dfb0763"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-76224d49-53c8-423e-9ead-c2cf16078371 req-0b904acd-7400-476b-9d85-677f960b90b5 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-76224d49-53c8-423e-9ead-c2cf16078371 req-0b904acd-7400-476b-9d85-677f960b90b5 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-76224d49-53c8-423e-9ead-c2cf16078371 req-0b904acd-7400-476b-9d85-677f960b90b5 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-76224d49-53c8-423e-9ead-c2cf16078371 req-0b904acd-7400-476b-9d85-677f960b90b5 service nova] Creating event network-changed:79c62453-7ae2-480d-aa21-a5f26dfb0763 for instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 on user Apr 13 23:01:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-76224d49-53c8-423e-9ead-c2cf16078371 req-0b904acd-7400-476b-9d85-677f960b90b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036294 Apr 13 23:01:26 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 145/439] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:01:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:26 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-112ef6d9-15cb-4115-a300-ec5c21c0f1ab tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:26 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-112ef6d9-15cb-4115-a300-ec5c21c0f1ab tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-112ef6d9-15cb-4115-a300-ec5c21c0f1ab tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-112ef6d9-15cb-4115-a300-ec5c21c0f1ab tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-112ef6d9-15cb-4115-a300-ec5c21c0f1ab tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-112ef6d9-15cb-4115-a300-ec5c21c0f1ab tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-112ef6d9-15cb-4115-a300-ec5c21c0f1ab tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-112ef6d9-15cb-4115-a300-ec5c21c0f1ab tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:26 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-112ef6d9-15cb-4115-a300-ec5c21c0f1ab tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91/ips" status: 200 len: 108 microversion: 2.1 time: 0.079022 Apr 13 23:01:26 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 147/440] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 23:01:26 2023] GET /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91/ips => generated 108 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:26 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-3b49f909-911b-4082-8e0c-2a96644f2ad0 req-053c8c63-c3d4-479d-abfd-916b710305c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2979e2c-7ef9-4cbd-8daf-dedd5103f857", "name": "network-vif-plugged", "status": "completed", "tag": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3b49f909-911b-4082-8e0c-2a96644f2ad0 req-053c8c63-c3d4-479d-abfd-916b710305c1 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3b49f909-911b-4082-8e0c-2a96644f2ad0 req-053c8c63-c3d4-479d-abfd-916b710305c1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3b49f909-911b-4082-8e0c-2a96644f2ad0 req-053c8c63-c3d4-479d-abfd-916b710305c1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:26 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-3b49f909-911b-4082-8e0c-2a96644f2ad0 req-053c8c63-c3d4-479d-abfd-916b710305c1 service nova] Creating event network-vif-plugged:5f5f289c-7a04-41f3-b5e8-73e45d3ac536 for instance a2979e2c-7ef9-4cbd-8daf-dedd5103f857 on user Apr 13 23:01:26 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-3b49f909-911b-4082-8e0c-2a96644f2ad0 req-053c8c63-c3d4-479d-abfd-916b710305c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051880 Apr 13 23:01:26 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 149/441] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:01:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:26 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b1861225-1c36-4f8a-9ae5-1fc03230d556 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Action: 'create', calling method: .version_select at 0x7f3d1c5070a0>, body: {"keypair": {"name": "tempest-keypair-1129500402", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7vlH4K190ZLaXGZADGTKyJqq1HrjF8mcn+GStKL4ZJ0L5vSiY+ekY/NcmigKtITRdMzH4ykVfwffOwzTyyJICm8WdBeAnwGlDcy6UYkDS+DFs4nMGVpTbq7hSi2P8hhA=="}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:27 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-b1861225-1c36-4f8a-9ae5-1fc03230d556 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Getting quotas for project 5b6a1fccc07f4f5a8f8f8617ae03955d. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:01:27 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-b1861225-1c36-4f8a-9ae5-1fc03230d556 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Getting quotas for user 28cb6d8d6e3d4ef7aa53bb17faf495c4 and project 5b6a1fccc07f4f5a8f8f8617ae03955d. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:01:27 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-b1861225-1c36-4f8a-9ae5-1fc03230d556 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091885 Apr 13 23:01:27 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 146/442] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 23:01:26 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-eb078b68-2d9f-4065-a13c-14ec5fcb9147 req-209e2958-d594-4fa5-8727-530dd3e33ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ec73b0-9b2a-4fc1-be85-4179075afdb8", "name": "network-vif-plugged", "status": "completed", "tag": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-eb078b68-2d9f-4065-a13c-14ec5fcb9147 req-209e2958-d594-4fa5-8727-530dd3e33ea7 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-eb078b68-2d9f-4065-a13c-14ec5fcb9147 req-209e2958-d594-4fa5-8727-530dd3e33ea7 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-eb078b68-2d9f-4065-a13c-14ec5fcb9147 req-209e2958-d594-4fa5-8727-530dd3e33ea7 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-eb078b68-2d9f-4065-a13c-14ec5fcb9147 req-209e2958-d594-4fa5-8727-530dd3e33ea7 service nova] Creating event network-vif-plugged:0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 on user Apr 13 23:01:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-eb078b68-2d9f-4065-a13c-14ec5fcb9147 req-209e2958-d594-4fa5-8727-530dd3e33ea7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044720 Apr 13 23:01:27 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 148/443] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:01:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 23:01:28 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:01:28 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:01:28 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2fc1b14-26b8-4e46-bcb1-9500056d5263"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:28 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:29 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1127216369", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "3586c352-7de6-4c50-a421-23f8709105d0"}], "security_groups": [{"name": "tempest-securitygroup--858970643"}], "key_name": "tempest-keypair-1129500402", "user_data": "}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:29 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] validate_networks() for [('3586c352-7de6-4c50-a421-23f8709105d0', None, None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:01:29 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352923 Apr 13 23:01:29 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 150/444] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 23:01:28 2023] POST /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:29 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-e9668b01-4e6f-4fe7-bb3c-c51ec1a4f224 req-fae46811-b83f-43fe-8ba9-8ad19ed2d1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ec73b0-9b2a-4fc1-be85-4179075afdb8", "name": "network-vif-plugged", "status": "completed", "tag": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e9668b01-4e6f-4fe7-bb3c-c51ec1a4f224 req-fae46811-b83f-43fe-8ba9-8ad19ed2d1d8 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e9668b01-4e6f-4fe7-bb3c-c51ec1a4f224 req-fae46811-b83f-43fe-8ba9-8ad19ed2d1d8 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e9668b01-4e6f-4fe7-bb3c-c51ec1a4f224 req-fae46811-b83f-43fe-8ba9-8ad19ed2d1d8 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:29 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-e9668b01-4e6f-4fe7-bb3c-c51ec1a4f224 req-fae46811-b83f-43fe-8ba9-8ad19ed2d1d8 service nova] Creating event network-vif-plugged:0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 on user Apr 13 23:01:29 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-e9668b01-4e6f-4fe7-bb3c-c51ec1a4f224 req-fae46811-b83f-43fe-8ba9-8ad19ed2d1d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041188 Apr 13 23:01:29 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 149/445] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:01:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:29 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:01:29 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:01:29 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:01:29 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:01:29 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:01:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:29 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Getting quotas for project 5b6a1fccc07f4f5a8f8f8617ae03955d. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:01:29 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Getting quotas for user 28cb6d8d6e3d4ef7aa53bb17faf495c4 and project 5b6a1fccc07f4f5a8f8f8617ae03955d. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:01:29 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:01:29 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:01:29 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.813562 Apr 13 23:01:29 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 147/446] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:01:29 2023] POST /compute/v2.1/servers => generated 406 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 13 23:01:29 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-6c71addb-3fb3-47f7-a453-7b2d2eab8136 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:29 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-6c71addb-3fb3-47f7-a453-7b2d2eab8136 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:30 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-6c71addb-3fb3-47f7-a453-7b2d2eab8136 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:01:30 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-6c71addb-3fb3-47f7-a453-7b2d2eab8136 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195" status: 200 len: 1240 microversion: 2.1 time: 0.091811 Apr 13 23:01:30 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 151/447] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:01:29 2023] GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:01:34 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-6ffff0c3-f0ba-4c64-8e28-7026812b5b65 req-2fa0758a-71c4-47be-a74d-2894e2bbb1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6ffff0c3-f0ba-4c64-8e28-7026812b5b65 req-2fa0758a-71c4-47be-a74d-2894e2bbb1f5 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6ffff0c3-f0ba-4c64-8e28-7026812b5b65 req-2fa0758a-71c4-47be-a74d-2894e2bbb1f5 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6ffff0c3-f0ba-4c64-8e28-7026812b5b65 req-2fa0758a-71c4-47be-a74d-2894e2bbb1f5 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:34 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-6ffff0c3-f0ba-4c64-8e28-7026812b5b65 req-2fa0758a-71c4-47be-a74d-2894e2bbb1f5 service nova] Creating event network-changed:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:01:34 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-6ffff0c3-f0ba-4c64-8e28-7026812b5b65 req-2fa0758a-71c4-47be-a74d-2894e2bbb1f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038663 Apr 13 23:01:34 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 150/448] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:01:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:36 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-89276ca4-534c-42b9-ab51-49ff7f540b38 req-e4dfebb3-bc46-459d-a946-86d5b6bb0ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "name": "network-vif-plugged", "status": "completed", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:36 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-89276ca4-534c-42b9-ab51-49ff7f540b38 req-e4dfebb3-bc46-459d-a946-86d5b6bb0ef2 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:36 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-89276ca4-534c-42b9-ab51-49ff7f540b38 req-e4dfebb3-bc46-459d-a946-86d5b6bb0ef2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:36 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-89276ca4-534c-42b9-ab51-49ff7f540b38 req-e4dfebb3-bc46-459d-a946-86d5b6bb0ef2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:36 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-89276ca4-534c-42b9-ab51-49ff7f540b38 req-e4dfebb3-bc46-459d-a946-86d5b6bb0ef2 service nova] Creating event network-vif-plugged:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:01:36 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-89276ca4-534c-42b9-ab51-49ff7f540b38 req-e4dfebb3-bc46-459d-a946-86d5b6bb0ef2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035685 Apr 13 23:01:36 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 148/449] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:01:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:37 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8d4fcf3a-ef21-41df-a198-1e8f90916fe0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:37 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-8d4fcf3a-ef21-41df-a198-1e8f90916fe0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8d4fcf3a-ef21-41df-a198-1e8f90916fe0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8d4fcf3a-ef21-41df-a198-1e8f90916fe0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8d4fcf3a-ef21-41df-a198-1e8f90916fe0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8d4fcf3a-ef21-41df-a198-1e8f90916fe0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8d4fcf3a-ef21-41df-a198-1e8f90916fe0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8d4fcf3a-ef21-41df-a198-1e8f90916fe0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:37 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-8d4fcf3a-ef21-41df-a198-1e8f90916fe0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] HTTP exception thrown: Instance bc51e254-7d38-49f6-816e-947d92f95950 could not be found. Apr 13 23:01:37 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8d4fcf3a-ef21-41df-a198-1e8f90916fe0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Request method failure captured: Apr 13 23:01:37 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/bc51e254-7d38-49f6-816e-947d92f95950 HTTP/1.1 Apr 13 23:01:37 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:01:37 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:01:37 user devstack@n-api.service[61613]: Connection: close Apr 13 23:01:37 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:01:37 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:01:37 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:01:37 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:01:37 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:01:37 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIgE6Gl7ZSFkA-_Uvg9_1wPLldz_ScwHJLtH7XfCRP3AC2MJmMpZ7l9bcSBPK09rKumFcFKFuRTWt2Sf1d4N5k3NQaJGxn8JzsH44PLD5fzCs7WE6phnuUwwFlbCj4pm_qJgudGzAbO1tRiQjdcyEvfY3Ke0cXzXFHfEZxyouzAaMTk Apr 13 23:01:37 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:01:37 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:01:37 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:01:37 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:01:37 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:01:37 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:01:37 user devstack@n-api.service[61613]: X-Project-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:01:37 user devstack@n-api.service[61613]: X-Project-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:01:37 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:01:37 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:01:37 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:01:37 user devstack@n-api.service[61613]: X-Tenant: tempest-TestVolumeBootPattern-751187467 Apr 13 23:01:37 user devstack@n-api.service[61613]: X-Tenant-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:01:37 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:01:37 user devstack@n-api.service[61613]: X-User: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:01:37 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:01:37 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:01:37 user devstack@n-api.service[61613]: X-User-Id: b289294050af4c41aeef8401832487a1 Apr 13 23:01:37 user devstack@n-api.service[61613]: X-User-Name: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:01:37 user devstack@n-api.service[61613]: method: > Apr 13 23:01:37 user devstack@n-api.service[61613]: exception: Instance bc51e254-7d38-49f6-816e-947d92f95950 could not be found. Apr 13 23:01:37 user devstack@n-api.service[61613]: action_args: {'id': 'bc51e254-7d38-49f6-816e-947d92f95950'} Apr 13 23:01:37 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc51e254-7d38-49f6-816e-947d92f95950 could not be found. Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc51e254-7d38-49f6-816e-947d92f95950 could not be found. Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc51e254-7d38-49f6-816e-947d92f95950 could not be found. Apr 13 23:01:37 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:37 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8d4fcf3a-ef21-41df-a198-1e8f90916fe0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Returning 404 to user: Instance bc51e254-7d38-49f6-816e-947d92f95950 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:01:37 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-8d4fcf3a-ef21-41df-a198-1e8f90916fe0 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc51e254-7d38-49f6-816e-947d92f95950" status: 404 len: 111 microversion: 2.1 time: 0.034085 Apr 13 23:01:37 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 152/450] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:01:37 2023] GET /compute/v2.1/servers/bc51e254-7d38-49f6-816e-947d92f95950 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:01:38 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-1b41da0d-9ced-4489-8c60-2d93a8344321 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2fc1b14-26b8-4e46-bcb1-9500056d5263"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:38 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-1b41da0d-9ced-4489-8c60-2d93a8344321 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b41da0d-9ced-4489-8c60-2d93a8344321 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b41da0d-9ced-4489-8c60-2d93a8344321 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b41da0d-9ced-4489-8c60-2d93a8344321 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b41da0d-9ced-4489-8c60-2d93a8344321 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b41da0d-9ced-4489-8c60-2d93a8344321 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b41da0d-9ced-4489-8c60-2d93a8344321 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:38 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-1b41da0d-9ced-4489-8c60-2d93a8344321 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] HTTP exception thrown: Invalid volume: volume c2fc1b14-26b8-4e46-bcb1-9500056d5263 is already attached to instances: 4435b0c4-7292-4348-bcd9-a712a2df3e91 Apr 13 23:01:38 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-1b41da0d-9ced-4489-8c60-2d93a8344321 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Request method failure captured: Apr 13 23:01:38 user devstack@n-api.service[61612]: request: POST /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91/os-volume_attachments HTTP/1.1 Apr 13 23:01:38 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:01:38 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:01:38 user devstack@n-api.service[61612]: Connection: close Apr 13 23:01:38 user devstack@n-api.service[61612]: Content-Length: 74 Apr 13 23:01:38 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:01:38 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:01:38 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:01:38 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:01:38 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIfFTd-GGuNLZhpg908qNRAUWwxNgAfeCUimfaNa0b2DAb_GHBW4t-lVsJou0tz2or0f6bqUrzjLpozKP8y8w6AYyySvjwkcbo4hPrDnlFVSF3sjpEAKCireroRzn4mK7Mj_j8ZmmwDUGWxo3vQ2pAQyz117nhwbP810jFnZYlkUbLs Apr 13 23:01:38 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:01:38 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:01:38 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:01:38 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:01:38 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:01:38 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:01:38 user devstack@n-api.service[61612]: X-Project-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:01:38 user devstack@n-api.service[61612]: X-Project-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:01:38 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:01:38 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:01:38 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:01:38 user devstack@n-api.service[61612]: X-Tenant: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:01:38 user devstack@n-api.service[61612]: X-Tenant-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:01:38 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:01:38 user devstack@n-api.service[61612]: X-User: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:01:38 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:01:38 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:01:38 user devstack@n-api.service[61612]: X-User-Id: 98594f3f6ccf4ffdbfd91bcf192d936e Apr 13 23:01:38 user devstack@n-api.service[61612]: X-User-Name: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:01:38 user devstack@n-api.service[61612]: Apr 13 23:01:38 user devstack@n-api.service[61612]: {"volumeAttachment": {"volumeId": "c2fc1b14-26b8-4e46-bcb1-9500056d5263"}} Apr 13 23:01:38 user devstack@n-api.service[61612]: method: > Apr 13 23:01:38 user devstack@n-api.service[61612]: exception: Invalid volume: volume c2fc1b14-26b8-4e46-bcb1-9500056d5263 is already attached to instances: 4435b0c4-7292-4348-bcd9-a712a2df3e91 Apr 13 23:01:38 user devstack@n-api.service[61612]: action_args: {'server_id': '4435b0c4-7292-4348-bcd9-a712a2df3e91', 'body': {'volumeAttachment': {'volumeId': 'c2fc1b14-26b8-4e46-bcb1-9500056d5263'}}} Apr 13 23:01:38 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c2fc1b14-26b8-4e46-bcb1-9500056d5263 is already attached to instances: 4435b0c4-7292-4348-bcd9-a712a2df3e91 Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c2fc1b14-26b8-4e46-bcb1-9500056d5263 is already attached to instances: 4435b0c4-7292-4348-bcd9-a712a2df3e91 Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c2fc1b14-26b8-4e46-bcb1-9500056d5263 is already attached to instances: 4435b0c4-7292-4348-bcd9-a712a2df3e91 Apr 13 23:01:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:01:38 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-1b41da0d-9ced-4489-8c60-2d93a8344321 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Returning 400 to user: Invalid volume: volume c2fc1b14-26b8-4e46-bcb1-9500056d5263 is already attached to instances: 4435b0c4-7292-4348-bcd9-a712a2df3e91 {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:01:38 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-1b41da0d-9ced-4489-8c60-2d93a8344321 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.137500 Apr 13 23:01:38 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 151/451] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 23:01:38 2023] POST /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91/os-volume_attachments => generated 174 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:01:38 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:38 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:38 user devstack@n-api.service[61611]: DEBUG nova.objects.instance [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'services' on Instance uuid 4435b0c4-7292-4348-bcd9-a712a2df3e91 {{(pid=61611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:01:38 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-f5c60aa9-e3d3-4e77-9b25-9f97b858c27d req-2a53c3ac-d6fb-4fe6-8675-7d64472cb8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "name": "network-vif-plugged", "status": "completed", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-f5c60aa9-e3d3-4e77-9b25-9f97b858c27d req-2a53c3ac-d6fb-4fe6-8675-7d64472cb8b7 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-f5c60aa9-e3d3-4e77-9b25-9f97b858c27d req-2a53c3ac-d6fb-4fe6-8675-7d64472cb8b7 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-f5c60aa9-e3d3-4e77-9b25-9f97b858c27d req-2a53c3ac-d6fb-4fe6-8675-7d64472cb8b7 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:38 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-f5c60aa9-e3d3-4e77-9b25-9f97b858c27d req-2a53c3ac-d6fb-4fe6-8675-7d64472cb8b7 service nova] Creating event network-vif-plugged:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:01:38 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-f5c60aa9-e3d3-4e77-9b25-9f97b858c27d req-2a53c3ac-d6fb-4fe6-8675-7d64472cb8b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032605 Apr 13 23:01:38 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 153/452] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:01:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:38 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91/os-volume_attachments/c2fc1b14-26b8-4e46-bcb1-9500056d5263" status: 202 len: 0 microversion: 2.1 time: 0.250843 Apr 13 23:01:38 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 149/453] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 23:01:38 2023] DELETE /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91/os-volume_attachments/c2fc1b14-26b8-4e46-bcb1-9500056d5263 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:01:38 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-bb2584f3-4ddd-48e8-9c4f-31ffe2b4fa00 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:38 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-bb2584f3-4ddd-48e8-9c4f-31ffe2b4fa00 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bb2584f3-4ddd-48e8-9c4f-31ffe2b4fa00 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bb2584f3-4ddd-48e8-9c4f-31ffe2b4fa00 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bb2584f3-4ddd-48e8-9c4f-31ffe2b4fa00 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bb2584f3-4ddd-48e8-9c4f-31ffe2b4fa00 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bb2584f3-4ddd-48e8-9c4f-31ffe2b4fa00 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bb2584f3-4ddd-48e8-9c4f-31ffe2b4fa00 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:38 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-bb2584f3-4ddd-48e8-9c4f-31ffe2b4fa00 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078070 Apr 13 23:01:38 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 152/454] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:01:38 2023] GET /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:40 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:40 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:40 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:01:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:41 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:01:41 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6" status: 204 len: 0 microversion: 2.1 time: 0.140279 Apr 13 23:01:41 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 154/455] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:01:40 2023] DELETE /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:01:41 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:01:41 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=12 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:01:41 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-a19f2866-4cb9-41b3-ad04-cd2359a90d93 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:41 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-a19f2866-4cb9-41b3-ad04-cd2359a90d93 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a19f2866-4cb9-41b3-ad04-cd2359a90d93 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a19f2866-4cb9-41b3-ad04-cd2359a90d93 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a19f2866-4cb9-41b3-ad04-cd2359a90d93 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a19f2866-4cb9-41b3-ad04-cd2359a90d93 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a19f2866-4cb9-41b3-ad04-cd2359a90d93 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a19f2866-4cb9-41b3-ad04-cd2359a90d93 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:41 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-a19f2866-4cb9-41b3-ad04-cd2359a90d93 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:01:41 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-a19f2866-4cb9-41b3-ad04-cd2359a90d93 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6" status: 200 len: 1399 microversion: 2.1 time: 0.245944 Apr 13 23:01:41 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 150/456] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:01:41 2023] GET /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6 => generated 1399 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:01:41 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-897c787d-0431-42b0-801a-4a5093f748ee req-f7676ffb-8612-460f-abca-e791ca971219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c9ae9c-47df-41c7-8805-f6fe22bf09d6", "name": "network-vif-unplugged", "status": "completed", "tag": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-897c787d-0431-42b0-801a-4a5093f748ee req-f7676ffb-8612-460f-abca-e791ca971219 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-897c787d-0431-42b0-801a-4a5093f748ee req-f7676ffb-8612-460f-abca-e791ca971219 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-897c787d-0431-42b0-801a-4a5093f748ee req-f7676ffb-8612-460f-abca-e791ca971219 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:41 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-897c787d-0431-42b0-801a-4a5093f748ee req-f7676ffb-8612-460f-abca-e791ca971219 service nova] Creating event network-vif-unplugged:b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c for instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 on user Apr 13 23:01:41 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-897c787d-0431-42b0-801a-4a5093f748ee req-f7676ffb-8612-460f-abca-e791ca971219 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039696 Apr 13 23:01:41 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 153/457] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:01:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:42 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-05f767e0-b3af-4fc5-9c75-b40db2e7baf8 req-ae464137-edca-4fe1-b8fa-b55fe3a79e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c9ae9c-47df-41c7-8805-f6fe22bf09d6", "name": "network-vif-deleted", "tag": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:43 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-05f767e0-b3af-4fc5-9c75-b40db2e7baf8 req-ae464137-edca-4fe1-b8fa-b55fe3a79e15 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:43 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-05f767e0-b3af-4fc5-9c75-b40db2e7baf8 req-ae464137-edca-4fe1-b8fa-b55fe3a79e15 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:43 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-05f767e0-b3af-4fc5-9c75-b40db2e7baf8 req-ae464137-edca-4fe1-b8fa-b55fe3a79e15 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:43 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-05f767e0-b3af-4fc5-9c75-b40db2e7baf8 req-ae464137-edca-4fe1-b8fa-b55fe3a79e15 service nova] Creating event network-vif-deleted:b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c for instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 on user Apr 13 23:01:43 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-05f767e0-b3af-4fc5-9c75-b40db2e7baf8 req-ae464137-edca-4fe1-b8fa-b55fe3a79e15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033203 Apr 13 23:01:43 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 155/458] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:01:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:43 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-89c55586-07c3-4597-8799-b14a80e09311 req-6ebeb5bf-58a9-43c5-9c51-0d5dc463eedd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c9ae9c-47df-41c7-8805-f6fe22bf09d6", "name": "network-vif-plugged", "status": "completed", "tag": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-89c55586-07c3-4597-8799-b14a80e09311 req-6ebeb5bf-58a9-43c5-9c51-0d5dc463eedd service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-89c55586-07c3-4597-8799-b14a80e09311 req-6ebeb5bf-58a9-43c5-9c51-0d5dc463eedd service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-89c55586-07c3-4597-8799-b14a80e09311 req-6ebeb5bf-58a9-43c5-9c51-0d5dc463eedd service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:43 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-89c55586-07c3-4597-8799-b14a80e09311 req-6ebeb5bf-58a9-43c5-9c51-0d5dc463eedd service nova] Creating event network-vif-plugged:b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c for instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 on user Apr 13 23:01:43 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-89c55586-07c3-4597-8799-b14a80e09311 req-6ebeb5bf-58a9-43c5-9c51-0d5dc463eedd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030062 Apr 13 23:01:43 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 151/459] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:01:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-cb23e2bf-364e-43fe-813a-dbfb65b974be tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:48 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-cb23e2bf-364e-43fe-813a-dbfb65b974be tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:48 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=23 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:01:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cb23e2bf-364e-43fe-813a-dbfb65b974be tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cb23e2bf-364e-43fe-813a-dbfb65b974be tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cb23e2bf-364e-43fe-813a-dbfb65b974be tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cb23e2bf-364e-43fe-813a-dbfb65b974be tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cb23e2bf-364e-43fe-813a-dbfb65b974be tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cb23e2bf-364e-43fe-813a-dbfb65b974be tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:48 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:01:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-cb23e2bf-364e-43fe-813a-dbfb65b974be tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051375 Apr 13 23:01:48 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 154/460] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:01:48 2023] GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 23:01:48 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-c69348bf-6ec1-44f8-8c5b-9263b21fa187 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:48 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-c69348bf-6ec1-44f8-8c5b-9263b21fa187 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c69348bf-6ec1-44f8-8c5b-9263b21fa187 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c69348bf-6ec1-44f8-8c5b-9263b21fa187 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c69348bf-6ec1-44f8-8c5b-9263b21fa187 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c69348bf-6ec1-44f8-8c5b-9263b21fa187 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c69348bf-6ec1-44f8-8c5b-9263b21fa187 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c69348bf-6ec1-44f8-8c5b-9263b21fa187 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:48 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:01:48 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-c69348bf-6ec1-44f8-8c5b-9263b21fa187 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] HTTP exception thrown: Instance b190941d-9f62-41ef-881d-e02d246e9138 is not attached to volume 31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c Apr 13 23:01:48 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-c69348bf-6ec1-44f8-8c5b-9263b21fa187 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Request method failure captured: Apr 13 23:01:48 user devstack@n-api.service[61613]: request: DELETE /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138/os-volume_attachments/31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c HTTP/1.1 Apr 13 23:01:48 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:01:48 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:01:48 user devstack@n-api.service[61613]: Connection: close Apr 13 23:01:48 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:01:48 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:01:48 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:01:48 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:01:48 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:01:48 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIiqmOc_jLwesAQk99mPpAwX4yPkvI4gxc0CX79zo2U49YpOkE1P1Vgrgx0AIOV4uSWhOhTpAt3ClJ1sc2omO3e6uzmuNuDjNfjdF-ljuOMYFVYPTVI7GUSixFeXrIvRxQWRt5GRaZsPC5aFcdH4Eq-k5brL5De7wLsJ-zubuNON-es Apr 13 23:01:48 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:01:48 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:01:48 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:01:48 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:01:48 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:01:48 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:01:48 user devstack@n-api.service[61613]: X-Project-Id: cf532d1c87a34b8cbde0f162688f7cdb Apr 13 23:01:48 user devstack@n-api.service[61613]: X-Project-Name: tempest-TestMinimumBasicScenario-146514025 Apr 13 23:01:48 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:01:48 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:01:48 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf532d1c87a34b8cbde0f162688f7cdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf532d1c87a34b8cbde0f162688f7cdb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf532d1c87a34b8cbde0f162688f7cdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:01:48 user devstack@n-api.service[61613]: X-Tenant: tempest-TestMinimumBasicScenario-146514025 Apr 13 23:01:48 user devstack@n-api.service[61613]: X-Tenant-Id: cf532d1c87a34b8cbde0f162688f7cdb Apr 13 23:01:48 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-TestMinimumBasicScenario-146514025 Apr 13 23:01:48 user devstack@n-api.service[61613]: X-User: tempest-TestMinimumBasicScenario-146514025-project-member Apr 13 23:01:48 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:01:48 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:01:48 user devstack@n-api.service[61613]: X-User-Id: fad76e3a6e154feaa62d95f6e7d1ce1c Apr 13 23:01:48 user devstack@n-api.service[61613]: X-User-Name: tempest-TestMinimumBasicScenario-146514025-project-member Apr 13 23:01:48 user devstack@n-api.service[61613]: method: > Apr 13 23:01:48 user devstack@n-api.service[61613]: exception: Instance b190941d-9f62-41ef-881d-e02d246e9138 is not attached to volume 31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c Apr 13 23:01:48 user devstack@n-api.service[61613]: action_args: {'server_id': 'b190941d-9f62-41ef-881d-e02d246e9138', 'id': '31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c'} Apr 13 23:01:48 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c. Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b190941d-9f62-41ef-881d-e02d246e9138 is not attached to volume 31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b190941d-9f62-41ef-881d-e02d246e9138 is not attached to volume 31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c Apr 13 23:01:48 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:48 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-c69348bf-6ec1-44f8-8c5b-9263b21fa187 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Returning 404 to user: Instance b190941d-9f62-41ef-881d-e02d246e9138 is not attached to volume 31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:01:48 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-c69348bf-6ec1-44f8-8c5b-9263b21fa187 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138/os-volume_attachments/31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c" status: 404 len: 154 microversion: 2.1 time: 0.096707 Apr 13 23:01:48 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 156/461] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 23:01:48 2023] DELETE /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138/os-volume_attachments/31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:01:50 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:50 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:50 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:01:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:50 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:01:50 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:01:50 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138" status: 204 len: 0 microversion: 2.1 time: 0.153053 Apr 13 23:01:50 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 152/462] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:01:50 2023] DELETE /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:01:50 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-601cd696-569a-469d-ba5a-50a380688c72 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:50 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-601cd696-569a-469d-ba5a-50a380688c72 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-601cd696-569a-469d-ba5a-50a380688c72 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-601cd696-569a-469d-ba5a-50a380688c72 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-601cd696-569a-469d-ba5a-50a380688c72 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-601cd696-569a-469d-ba5a-50a380688c72 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-601cd696-569a-469d-ba5a-50a380688c72 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-601cd696-569a-469d-ba5a-50a380688c72 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:51 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-601cd696-569a-469d-ba5a-50a380688c72 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:01:51 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-601cd696-569a-469d-ba5a-50a380688c72 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138" status: 200 len: 1543 microversion: 2.1 time: 0.252492 Apr 13 23:01:51 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 155/463] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:01:50 2023] GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138 => generated 1543 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 23:01:51 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-8d65b906-b407-44cf-bae3-9f73a7ede109 req-464bad47-5998-4332-8bc0-638b1a2b72d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b190941d-9f62-41ef-881d-e02d246e9138", "name": "network-vif-unplugged", "status": "completed", "tag": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:51 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:01:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8d65b906-b407-44cf-bae3-9f73a7ede109 req-464bad47-5998-4332-8bc0-638b1a2b72d1 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8d65b906-b407-44cf-bae3-9f73a7ede109 req-464bad47-5998-4332-8bc0-638b1a2b72d1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8d65b906-b407-44cf-bae3-9f73a7ede109 req-464bad47-5998-4332-8bc0-638b1a2b72d1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:51 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-8d65b906-b407-44cf-bae3-9f73a7ede109 req-464bad47-5998-4332-8bc0-638b1a2b72d1 service nova] Creating event network-vif-unplugged:37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance b190941d-9f62-41ef-881d-e02d246e9138 on user Apr 13 23:01:51 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-8d65b906-b407-44cf-bae3-9f73a7ede109 req-464bad47-5998-4332-8bc0-638b1a2b72d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035568 Apr 13 23:01:51 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 157/464] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:01:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:52 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-7f1160cb-ba27-4c1d-a498-1da1896c51fe req-197bb00d-de17-4332-9d4a-619b2427d22f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b190941d-9f62-41ef-881d-e02d246e9138", "name": "network-vif-deleted", "tag": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-7f1160cb-ba27-4c1d-a498-1da1896c51fe req-197bb00d-de17-4332-9d4a-619b2427d22f service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-7f1160cb-ba27-4c1d-a498-1da1896c51fe req-197bb00d-de17-4332-9d4a-619b2427d22f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-7f1160cb-ba27-4c1d-a498-1da1896c51fe req-197bb00d-de17-4332-9d4a-619b2427d22f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:52 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-7f1160cb-ba27-4c1d-a498-1da1896c51fe req-197bb00d-de17-4332-9d4a-619b2427d22f service nova] Creating event network-vif-deleted:37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance b190941d-9f62-41ef-881d-e02d246e9138 on user Apr 13 23:01:52 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-7f1160cb-ba27-4c1d-a498-1da1896c51fe req-197bb00d-de17-4332-9d4a-619b2427d22f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047787 Apr 13 23:01:52 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 153/465] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:01:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:53 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-d04ebc00-8977-42e9-b933-f98562f01e38 req-4c9d4410-331e-417f-8188-05ce72181666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b190941d-9f62-41ef-881d-e02d246e9138", "name": "network-vif-plugged", "status": "completed", "tag": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:01:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d04ebc00-8977-42e9-b933-f98562f01e38 req-4c9d4410-331e-417f-8188-05ce72181666 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d04ebc00-8977-42e9-b933-f98562f01e38 req-4c9d4410-331e-417f-8188-05ce72181666 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d04ebc00-8977-42e9-b933-f98562f01e38 req-4c9d4410-331e-417f-8188-05ce72181666 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:53 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-d04ebc00-8977-42e9-b933-f98562f01e38 req-4c9d4410-331e-417f-8188-05ce72181666 service nova] Creating event network-vif-plugged:37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance b190941d-9f62-41ef-881d-e02d246e9138 on user Apr 13 23:01:53 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-d04ebc00-8977-42e9-b933-f98562f01e38 req-4c9d4410-331e-417f-8188-05ce72181666 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032327 Apr 13 23:01:53 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 156/466] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:01:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:01:55 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8b28dfc5-3ce1-4c6e-81b2-80233a89a2fc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:55 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-8b28dfc5-3ce1-4c6e-81b2-80233a89a2fc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8b28dfc5-3ce1-4c6e-81b2-80233a89a2fc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8b28dfc5-3ce1-4c6e-81b2-80233a89a2fc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8b28dfc5-3ce1-4c6e-81b2-80233a89a2fc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8b28dfc5-3ce1-4c6e-81b2-80233a89a2fc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8b28dfc5-3ce1-4c6e-81b2-80233a89a2fc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8b28dfc5-3ce1-4c6e-81b2-80233a89a2fc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:55 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-8b28dfc5-3ce1-4c6e-81b2-80233a89a2fc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] HTTP exception thrown: Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a could not be found. Apr 13 23:01:55 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8b28dfc5-3ce1-4c6e-81b2-80233a89a2fc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Request method failure captured: Apr 13 23:01:55 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a HTTP/1.1 Apr 13 23:01:55 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:01:55 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:01:55 user devstack@n-api.service[61613]: Connection: close Apr 13 23:01:55 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:01:55 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:01:55 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:01:55 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:01:55 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:01:55 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIjwdmReXUcHCkADMqTwXMOwff9FdaPe6B64cUMdBsLOOvKefuT99AzrF5AcDfXrdldfPazoev3GHx7BSkL3AyeGVKe5ZiMtOkFwLuPUvBqbGlnm6nlQg8U-wilz7sQZcScEDOtZNpxl1PoThrCtoCDPOV9P6OHkzmJja6llEBFPA9o Apr 13 23:01:55 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:01:55 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:01:55 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:01:55 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:01:55 user devstack@n-api.service[61613]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 23:01:55 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:01:55 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:01:55 user devstack@n-api.service[61613]: X-Project-Id: f8b1ce9b9f4d4adf8316110aae9e04d7 Apr 13 23:01:55 user devstack@n-api.service[61613]: X-Project-Name: tempest-TaggedAttachmentsTest-1196616995 Apr 13 23:01:55 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:01:55 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:01:55 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f8b1ce9b9f4d4adf8316110aae9e04d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f8b1ce9b9f4d4adf8316110aae9e04d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f8b1ce9b9f4d4adf8316110aae9e04d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:01:55 user devstack@n-api.service[61613]: X-Tenant: tempest-TaggedAttachmentsTest-1196616995 Apr 13 23:01:55 user devstack@n-api.service[61613]: X-Tenant-Id: f8b1ce9b9f4d4adf8316110aae9e04d7 Apr 13 23:01:55 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1196616995 Apr 13 23:01:55 user devstack@n-api.service[61613]: X-User: tempest-TaggedAttachmentsTest-1196616995-project-member Apr 13 23:01:55 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:01:55 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:01:55 user devstack@n-api.service[61613]: X-User-Id: 9ec0b2d09be54070ab00037165788f8a Apr 13 23:01:55 user devstack@n-api.service[61613]: X-User-Name: tempest-TaggedAttachmentsTest-1196616995-project-member Apr 13 23:01:55 user devstack@n-api.service[61613]: method: > Apr 13 23:01:55 user devstack@n-api.service[61613]: exception: Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a could not be found. Apr 13 23:01:55 user devstack@n-api.service[61613]: action_args: {'id': '3f6a020c-d8b5-4f6b-a3f0-38287111153a'} Apr 13 23:01:55 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a could not be found. Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a could not be found. Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a could not be found. Apr 13 23:01:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:55 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8b28dfc5-3ce1-4c6e-81b2-80233a89a2fc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Returning 404 to user: Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:01:55 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-8b28dfc5-3ce1-4c6e-81b2-80233a89a2fc tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a" status: 404 len: 111 microversion: 2.49 time: 0.029993 Apr 13 23:01:55 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 158/467] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:01:55 2023] GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:01:55 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-4a646212-8deb-48ca-95ed-f9fde5ba1623 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Calling method '.version_select at 0x7f3d1c507760>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:55 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-4a646212-8deb-48ca-95ed-f9fde5ba1623 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-47503195" status: 204 len: 0 microversion: 2.49 time: 0.021760 Apr 13 23:01:55 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 154/468] 10.0.0.210 () {64 vars in 1333 bytes} [Thu Apr 13 23:01:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-47503195 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 23:01:56 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-4cda114f-a505-4a1e-8141-e1b94689fbf6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:56 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-4cda114f-a505-4a1e-8141-e1b94689fbf6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4cda114f-a505-4a1e-8141-e1b94689fbf6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4cda114f-a505-4a1e-8141-e1b94689fbf6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4cda114f-a505-4a1e-8141-e1b94689fbf6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4cda114f-a505-4a1e-8141-e1b94689fbf6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4cda114f-a505-4a1e-8141-e1b94689fbf6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4cda114f-a505-4a1e-8141-e1b94689fbf6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:56 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-4cda114f-a505-4a1e-8141-e1b94689fbf6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] HTTP exception thrown: Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a could not be found. Apr 13 23:01:56 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-4cda114f-a505-4a1e-8141-e1b94689fbf6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Request method failure captured: Apr 13 23:01:56 user devstack@n-api.service[61612]: request: DELETE /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a HTTP/1.1 Apr 13 23:01:56 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:01:56 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:01:56 user devstack@n-api.service[61612]: Connection: close Apr 13 23:01:56 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:01:56 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:01:56 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:01:56 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:01:56 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:01:56 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIjwdmReXUcHCkADMqTwXMOwff9FdaPe6B64cUMdBsLOOvKefuT99AzrF5AcDfXrdldfPazoev3GHx7BSkL3AyeGVKe5ZiMtOkFwLuPUvBqbGlnm6nlQg8U-wilz7sQZcScEDOtZNpxl1PoThrCtoCDPOV9P6OHkzmJja6llEBFPA9o Apr 13 23:01:56 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:01:56 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:01:56 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:01:56 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:01:56 user devstack@n-api.service[61612]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 23:01:56 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:01:56 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:01:56 user devstack@n-api.service[61612]: X-Project-Id: f8b1ce9b9f4d4adf8316110aae9e04d7 Apr 13 23:01:56 user devstack@n-api.service[61612]: X-Project-Name: tempest-TaggedAttachmentsTest-1196616995 Apr 13 23:01:56 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:01:56 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:01:56 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f8b1ce9b9f4d4adf8316110aae9e04d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f8b1ce9b9f4d4adf8316110aae9e04d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f8b1ce9b9f4d4adf8316110aae9e04d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:01:56 user devstack@n-api.service[61612]: X-Tenant: tempest-TaggedAttachmentsTest-1196616995 Apr 13 23:01:56 user devstack@n-api.service[61612]: X-Tenant-Id: f8b1ce9b9f4d4adf8316110aae9e04d7 Apr 13 23:01:56 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1196616995 Apr 13 23:01:56 user devstack@n-api.service[61612]: X-User: tempest-TaggedAttachmentsTest-1196616995-project-member Apr 13 23:01:56 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:01:56 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:01:56 user devstack@n-api.service[61612]: X-User-Id: 9ec0b2d09be54070ab00037165788f8a Apr 13 23:01:56 user devstack@n-api.service[61612]: X-User-Name: tempest-TaggedAttachmentsTest-1196616995-project-member Apr 13 23:01:56 user devstack@n-api.service[61612]: method: > Apr 13 23:01:56 user devstack@n-api.service[61612]: exception: Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a could not be found. Apr 13 23:01:56 user devstack@n-api.service[61612]: action_args: {'id': '3f6a020c-d8b5-4f6b-a3f0-38287111153a'} Apr 13 23:01:56 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a could not be found. Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a could not be found. Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a could not be found. Apr 13 23:01:56 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:01:56 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-4cda114f-a505-4a1e-8141-e1b94689fbf6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Returning 404 to user: Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:01:56 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-4cda114f-a505-4a1e-8141-e1b94689fbf6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a" status: 404 len: 111 microversion: 2.49 time: 0.028965 Apr 13 23:01:56 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 157/469] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 23:01:56 2023] DELETE /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:01:56 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-7388d024-ad8a-4ac4-8947-e796f055a50d tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:01:56 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-7388d024-ad8a-4ac4-8947-e796f055a50d tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:01:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7388d024-ad8a-4ac4-8947-e796f055a50d tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7388d024-ad8a-4ac4-8947-e796f055a50d tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7388d024-ad8a-4ac4-8947-e796f055a50d tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7388d024-ad8a-4ac4-8947-e796f055a50d tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:01:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7388d024-ad8a-4ac4-8947-e796f055a50d tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:01:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7388d024-ad8a-4ac4-8947-e796f055a50d tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:01:56 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-7388d024-ad8a-4ac4-8947-e796f055a50d tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] HTTP exception thrown: Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a could not be found. Apr 13 23:01:56 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-7388d024-ad8a-4ac4-8947-e796f055a50d tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Request method failure captured: Apr 13 23:01:56 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a HTTP/1.1 Apr 13 23:01:56 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:01:56 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:01:56 user devstack@n-api.service[61613]: Connection: close Apr 13 23:01:56 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:01:56 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:01:56 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:01:56 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:01:56 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:01:56 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIjwdmReXUcHCkADMqTwXMOwff9FdaPe6B64cUMdBsLOOvKefuT99AzrF5AcDfXrdldfPazoev3GHx7BSkL3AyeGVKe5ZiMtOkFwLuPUvBqbGlnm6nlQg8U-wilz7sQZcScEDOtZNpxl1PoThrCtoCDPOV9P6OHkzmJja6llEBFPA9o Apr 13 23:01:56 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:01:56 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:01:56 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:01:56 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:01:56 user devstack@n-api.service[61613]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 23:01:56 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:01:56 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:01:56 user devstack@n-api.service[61613]: X-Project-Id: f8b1ce9b9f4d4adf8316110aae9e04d7 Apr 13 23:01:56 user devstack@n-api.service[61613]: X-Project-Name: tempest-TaggedAttachmentsTest-1196616995 Apr 13 23:01:56 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:01:56 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:01:56 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f8b1ce9b9f4d4adf8316110aae9e04d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f8b1ce9b9f4d4adf8316110aae9e04d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f8b1ce9b9f4d4adf8316110aae9e04d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:01:56 user devstack@n-api.service[61613]: X-Tenant: tempest-TaggedAttachmentsTest-1196616995 Apr 13 23:01:56 user devstack@n-api.service[61613]: X-Tenant-Id: f8b1ce9b9f4d4adf8316110aae9e04d7 Apr 13 23:01:56 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1196616995 Apr 13 23:01:56 user devstack@n-api.service[61613]: X-User: tempest-TaggedAttachmentsTest-1196616995-project-member Apr 13 23:01:56 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:01:56 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:01:56 user devstack@n-api.service[61613]: X-User-Id: 9ec0b2d09be54070ab00037165788f8a Apr 13 23:01:56 user devstack@n-api.service[61613]: X-User-Name: tempest-TaggedAttachmentsTest-1196616995-project-member Apr 13 23:01:56 user devstack@n-api.service[61613]: method: > Apr 13 23:01:56 user devstack@n-api.service[61613]: exception: Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a could not be found. Apr 13 23:01:56 user devstack@n-api.service[61613]: action_args: {'id': '3f6a020c-d8b5-4f6b-a3f0-38287111153a'} Apr 13 23:01:56 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a could not be found. Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a could not be found. Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a could not be found. Apr 13 23:01:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:01:56 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-7388d024-ad8a-4ac4-8947-e796f055a50d tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Returning 404 to user: Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:01:56 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-7388d024-ad8a-4ac4-8947-e796f055a50d tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a" status: 404 len: 111 microversion: 2.49 time: 0.029795 Apr 13 23:01:56 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 159/470] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:01:56 2023] GET /compute/v2.1/servers/3f6a020c-d8b5-4f6b-a3f0-38287111153a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:02:08 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:02:08 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:02:08 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-8e1049b2-8d7a-4618-a668-3f9672abc1c0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:08 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-8e1049b2-8d7a-4618-a668-3f9672abc1c0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8e1049b2-8d7a-4618-a668-3f9672abc1c0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8e1049b2-8d7a-4618-a668-3f9672abc1c0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8e1049b2-8d7a-4618-a668-3f9672abc1c0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8e1049b2-8d7a-4618-a668-3f9672abc1c0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8e1049b2-8d7a-4618-a668-3f9672abc1c0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8e1049b2-8d7a-4618-a668-3f9672abc1c0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:09 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-8e1049b2-8d7a-4618-a668-3f9672abc1c0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eea00459cc046129decc442a6996ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea52ea14393449b3b0ce5a8ed973e435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:02:09 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-8e1049b2-8d7a-4618-a668-3f9672abc1c0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2979e2c-7ef9-4cbd-8daf-dedd5103f857" status: 200 len: 1453 microversion: 2.1 time: 0.160968 Apr 13 23:02:09 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 155/471] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:02:08 2023] GET /compute/v2.1/servers/a2979e2c-7ef9-4cbd-8daf-dedd5103f857 => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:02:11 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=7 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:02:11 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=15 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:02:11 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-8937a228-84ee-4912-ba1f-0aed1e6e8768 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:11 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-8937a228-84ee-4912-ba1f-0aed1e6e8768 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8937a228-84ee-4912-ba1f-0aed1e6e8768 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8937a228-84ee-4912-ba1f-0aed1e6e8768 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8937a228-84ee-4912-ba1f-0aed1e6e8768 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8937a228-84ee-4912-ba1f-0aed1e6e8768 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8937a228-84ee-4912-ba1f-0aed1e6e8768 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8937a228-84ee-4912-ba1f-0aed1e6e8768 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:12 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-8937a228-84ee-4912-ba1f-0aed1e6e8768 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:02:12 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-8937a228-84ee-4912-ba1f-0aed1e6e8768 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:02:12 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-8937a228-84ee-4912-ba1f-0aed1e6e8768 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:02:12 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-8937a228-84ee-4912-ba1f-0aed1e6e8768 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8" status: 200 len: 1754 microversion: 2.87 time: 0.438487 Apr 13 23:02:12 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 158/472] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:02:11 2023] GET /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8 => generated 1754 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:02:13 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=5 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:02:13 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=7 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:02:13 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-18447064", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "networks": [{"uuid": "767f78e8-a875-44f4-bb0d-64565b88a59d"}]}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:13 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] validate_networks() for [('767f78e8-a875-44f4-bb0d-64565b88a59d', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:02:13 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:02:13 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:02:13 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:02:13 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:02:13 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:02:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:13 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Getting quotas for project d8a3c684b0414336b2ca770eb1f3ab17. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:02:13 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Getting quotas for user 71593deacbd74fea9fc2faf5a9b08877 and project d8a3c684b0414336b2ca770eb1f3ab17. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:02:13 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:02:13 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:02:13 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.531766 Apr 13 23:02:13 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 160/473] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:02:13 2023] POST /compute/v2.1/servers => generated 378 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:02:13 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-197e276f-c598-4175-a1af-0f978bc01987 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:13 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-197e276f-c598-4175-a1af-0f978bc01987 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:14 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-197e276f-c598-4175-a1af-0f978bc01987 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71593deacbd74fea9fc2faf5a9b08877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a3c684b0414336b2ca770eb1f3ab17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:02:14 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-197e276f-c598-4175-a1af-0f978bc01987 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc473fb8-e574-4e49-b860-3ae0066cc9b8" status: 200 len: 1209 microversion: 2.1 time: 0.080533 Apr 13 23:02:14 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 156/474] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:02:13 2023] GET /compute/v2.1/servers/dc473fb8-e574-4e49-b860-3ae0066cc9b8 => generated 1209 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:02:16 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-a6fa6238-4f97-4bab-a37f-7357294bc053 req-cf0c696b-0d1c-4cae-9946-cc20781fab35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc473fb8-e574-4e49-b860-3ae0066cc9b8", "tag": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a6fa6238-4f97-4bab-a37f-7357294bc053 req-cf0c696b-0d1c-4cae-9946-cc20781fab35 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a6fa6238-4f97-4bab-a37f-7357294bc053 req-cf0c696b-0d1c-4cae-9946-cc20781fab35 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a6fa6238-4f97-4bab-a37f-7357294bc053 req-cf0c696b-0d1c-4cae-9946-cc20781fab35 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:16 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-a6fa6238-4f97-4bab-a37f-7357294bc053 req-cf0c696b-0d1c-4cae-9946-cc20781fab35 service nova] Creating event network-changed:29e91af8-5b8e-4872-9ee0-9cc4b79fb647 for instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 on user Apr 13 23:02:16 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-a6fa6238-4f97-4bab-a37f-7357294bc053 req-cf0c696b-0d1c-4cae-9946-cc20781fab35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027804 Apr 13 23:02:16 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 159/475] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:02:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:02:18 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-503b906a-521b-4763-9288-f5b318a6f07a tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:18 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-503b906a-521b-4763-9288-f5b318a6f07a tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-503b906a-521b-4763-9288-f5b318a6f07a tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-503b906a-521b-4763-9288-f5b318a6f07a tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-503b906a-521b-4763-9288-f5b318a6f07a tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-503b906a-521b-4763-9288-f5b318a6f07a tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-503b906a-521b-4763-9288-f5b318a6f07a tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-503b906a-521b-4763-9288-f5b318a6f07a tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:18 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-503b906a-521b-4763-9288-f5b318a6f07a tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.172113 Apr 13 23:02:18 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 161/476] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 23:02:18 2023] GET /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa/os-interface => generated 1831 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:02:18 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-9d5dad4f-5069-4d1f-8eff-f499828b8fd7 req-a061d334-c3b2-41aa-b5e2-98d3859d530e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc473fb8-e574-4e49-b860-3ae0066cc9b8", "name": "network-vif-plugged", "status": "completed", "tag": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9d5dad4f-5069-4d1f-8eff-f499828b8fd7 req-a061d334-c3b2-41aa-b5e2-98d3859d530e service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9d5dad4f-5069-4d1f-8eff-f499828b8fd7 req-a061d334-c3b2-41aa-b5e2-98d3859d530e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9d5dad4f-5069-4d1f-8eff-f499828b8fd7 req-a061d334-c3b2-41aa-b5e2-98d3859d530e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-9d5dad4f-5069-4d1f-8eff-f499828b8fd7 req-a061d334-c3b2-41aa-b5e2-98d3859d530e service nova] Creating event network-vif-plugged:29e91af8-5b8e-4872-9ee0-9cc4b79fb647 for instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 on user Apr 13 23:02:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-9d5dad4f-5069-4d1f-8eff-f499828b8fd7 req-a061d334-c3b2-41aa-b5e2-98d3859d530e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049927 Apr 13 23:02:18 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 157/477] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:02:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:02:19 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-82972e20-4e2d-48b3-91c6-75a4ae96f92a req-177c87d0-f9d9-44f5-87f0-a754ae8c148c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "tag": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-82972e20-4e2d-48b3-91c6-75a4ae96f92a req-177c87d0-f9d9-44f5-87f0-a754ae8c148c service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-82972e20-4e2d-48b3-91c6-75a4ae96f92a req-177c87d0-f9d9-44f5-87f0-a754ae8c148c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-82972e20-4e2d-48b3-91c6-75a4ae96f92a req-177c87d0-f9d9-44f5-87f0-a754ae8c148c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:19 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-82972e20-4e2d-48b3-91c6-75a4ae96f92a req-177c87d0-f9d9-44f5-87f0-a754ae8c148c service nova] Creating event network-changed:302fbc22-4c9a-48dc-bf40-4aec87dd4b92 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:02:19 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-82972e20-4e2d-48b3-91c6-75a4ae96f92a req-177c87d0-f9d9-44f5-87f0-a754ae8c148c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032546 Apr 13 23:02:19 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 160/478] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:02:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:02:19 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-fe8933dd-b8e8-47a6-bd51-988e427b7a8d tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:19 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-fe8933dd-b8e8-47a6-bd51-988e427b7a8d tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fe8933dd-b8e8-47a6-bd51-988e427b7a8d tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fe8933dd-b8e8-47a6-bd51-988e427b7a8d tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fe8933dd-b8e8-47a6-bd51-988e427b7a8d tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fe8933dd-b8e8-47a6-bd51-988e427b7a8d tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fe8933dd-b8e8-47a6-bd51-988e427b7a8d tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fe8933dd-b8e8-47a6-bd51-988e427b7a8d tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:19 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-fe8933dd-b8e8-47a6-bd51-988e427b7a8d tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16f28e6923c4fbfbb3c295377b6f9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3774169387c4fc59f3300af1a033087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:02:19 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-fe8933dd-b8e8-47a6-bd51-988e427b7a8d tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c16f28e6923c4fbfbb3c295377b6f9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3774169387c4fc59f3300af1a033087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:02:19 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-fe8933dd-b8e8-47a6-bd51-988e427b7a8d tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c16f28e6923c4fbfbb3c295377b6f9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3774169387c4fc59f3300af1a033087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:02:19 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-fe8933dd-b8e8-47a6-bd51-988e427b7a8d tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa" status: 200 len: 2821 microversion: 2.32 time: 0.295331 Apr 13 23:02:19 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 162/479] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:02:19 2023] GET /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa => generated 2821 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:02:19 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5d7ebff5-6dbb-42c2-a79a-38f90b620e4b tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:19 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-5d7ebff5-6dbb-42c2-a79a-38f90b620e4b tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5d7ebff5-6dbb-42c2-a79a-38f90b620e4b tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5d7ebff5-6dbb-42c2-a79a-38f90b620e4b tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5d7ebff5-6dbb-42c2-a79a-38f90b620e4b tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5d7ebff5-6dbb-42c2-a79a-38f90b620e4b tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5d7ebff5-6dbb-42c2-a79a-38f90b620e4b tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5d7ebff5-6dbb-42c2-a79a-38f90b620e4b tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-5d7ebff5-6dbb-42c2-a79a-38f90b620e4b tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.139918 Apr 13 23:02:19 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 158/480] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 23:02:19 2023] GET /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa/os-interface => generated 1831 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:02:20 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-6e30c1c3-7f32-4f94-9922-02464097bf09 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:20 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-6e30c1c3-7f32-4f94-9922-02464097bf09 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6e30c1c3-7f32-4f94-9922-02464097bf09 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6e30c1c3-7f32-4f94-9922-02464097bf09 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6e30c1c3-7f32-4f94-9922-02464097bf09 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6e30c1c3-7f32-4f94-9922-02464097bf09 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6e30c1c3-7f32-4f94-9922-02464097bf09 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6e30c1c3-7f32-4f94-9922-02464097bf09 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:20 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-6e30c1c3-7f32-4f94-9922-02464097bf09 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:02:20 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-6e30c1c3-7f32-4f94-9922-02464097bf09 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195" status: 200 len: 1553 microversion: 2.1 time: 0.293725 Apr 13 23:02:20 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 161/481] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:02:20 2023] GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195 => generated 1553 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:02:20 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-530e9720-c2c4-45ac-92a0-e3b6cc301a06 req-d92559af-4602-4bb2-98f3-a1e65a6aaf48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc473fb8-e574-4e49-b860-3ae0066cc9b8", "name": "network-vif-plugged", "status": "completed", "tag": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-530e9720-c2c4-45ac-92a0-e3b6cc301a06 req-d92559af-4602-4bb2-98f3-a1e65a6aaf48 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-530e9720-c2c4-45ac-92a0-e3b6cc301a06 req-d92559af-4602-4bb2-98f3-a1e65a6aaf48 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-530e9720-c2c4-45ac-92a0-e3b6cc301a06 req-d92559af-4602-4bb2-98f3-a1e65a6aaf48 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:20 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-530e9720-c2c4-45ac-92a0-e3b6cc301a06 req-d92559af-4602-4bb2-98f3-a1e65a6aaf48 service nova] Creating event network-vif-plugged:29e91af8-5b8e-4872-9ee0-9cc4b79fb647 for instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 on user Apr 13 23:02:20 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-530e9720-c2c4-45ac-92a0-e3b6cc301a06 req-d92559af-4602-4bb2-98f3-a1e65a6aaf48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033291 Apr 13 23:02:20 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 163/482] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:02:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:02:21 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:21 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:21 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:02:21 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa" status: 204 len: 0 microversion: 2.32 time: 0.139347 Apr 13 23:02:21 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 159/483] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 23:02:21 2023] DELETE /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 23:02:21 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-8f82868b-4b5c-4c80-9f98-6d89326de370 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:21 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-8f82868b-4b5c-4c80-9f98-6d89326de370 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8f82868b-4b5c-4c80-9f98-6d89326de370 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8f82868b-4b5c-4c80-9f98-6d89326de370 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8f82868b-4b5c-4c80-9f98-6d89326de370 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8f82868b-4b5c-4c80-9f98-6d89326de370 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8f82868b-4b5c-4c80-9f98-6d89326de370 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8f82868b-4b5c-4c80-9f98-6d89326de370 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:21 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-8f82868b-4b5c-4c80-9f98-6d89326de370 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16f28e6923c4fbfbb3c295377b6f9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3774169387c4fc59f3300af1a033087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:02:21 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-c0c860fc-6994-4c04-b6ef-7c505510e4d9 req-91e016c2-8bd8-4b17-9732-c1fa3411b121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-unplugged", "status": "completed", "tag": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c0c860fc-6994-4c04-b6ef-7c505510e4d9 req-91e016c2-8bd8-4b17-9732-c1fa3411b121 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c0c860fc-6994-4c04-b6ef-7c505510e4d9 req-91e016c2-8bd8-4b17-9732-c1fa3411b121 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c0c860fc-6994-4c04-b6ef-7c505510e4d9 req-91e016c2-8bd8-4b17-9732-c1fa3411b121 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:21 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-8f82868b-4b5c-4c80-9f98-6d89326de370 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c16f28e6923c4fbfbb3c295377b6f9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3774169387c4fc59f3300af1a033087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:02:21 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-8f82868b-4b5c-4c80-9f98-6d89326de370 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c16f28e6923c4fbfbb3c295377b6f9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3774169387c4fc59f3300af1a033087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:02:21 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-8f82868b-4b5c-4c80-9f98-6d89326de370 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa" status: 200 len: 2946 microversion: 2.32 time: 0.315973 Apr 13 23:02:21 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 162/484] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:02:21 2023] GET /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa => generated 2946 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 13 23:02:21 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-c0c860fc-6994-4c04-b6ef-7c505510e4d9 req-91e016c2-8bd8-4b17-9732-c1fa3411b121 service nova] Creating event network-vif-unplugged:302fbc22-4c9a-48dc-bf40-4aec87dd4b92 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:02:21 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-c0c860fc-6994-4c04-b6ef-7c505510e4d9 req-91e016c2-8bd8-4b17-9732-c1fa3411b121 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045850 Apr 13 23:02:21 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 164/485] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:02:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:02:21 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-599054c9-625a-40af-a475-d349be667dc4 req-38e1038d-0cca-4a8c-ac28-59a2711e9888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-unplugged", "status": "completed", "tag": "5d649918-bdcb-4b16-b701-1dbad3722881"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-599054c9-625a-40af-a475-d349be667dc4 req-38e1038d-0cca-4a8c-ac28-59a2711e9888 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-599054c9-625a-40af-a475-d349be667dc4 req-38e1038d-0cca-4a8c-ac28-59a2711e9888 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-599054c9-625a-40af-a475-d349be667dc4 req-38e1038d-0cca-4a8c-ac28-59a2711e9888 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:21 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-599054c9-625a-40af-a475-d349be667dc4 req-38e1038d-0cca-4a8c-ac28-59a2711e9888 service nova] Creating event network-vif-unplugged:5d649918-bdcb-4b16-b701-1dbad3722881 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:02:21 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-599054c9-625a-40af-a475-d349be667dc4 req-38e1038d-0cca-4a8c-ac28-59a2711e9888 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071125 Apr 13 23:02:21 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 160/486] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:02:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 23:02:22 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-unplugged", "status": "completed", "tag": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca"}, {"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca"}, {"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-unplugged", "status": "completed", "tag": "d7199650-e2d2-4349-af5f-357b9f511835"}, {"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "d7199650-e2d2-4349-af5f-357b9f511835"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:22 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] Creating event network-vif-unplugged:693e2c7e-e759-4e34-a3fb-ef2e51eecaca for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:02:22 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] Creating event network-vif-plugged:693e2c7e-e759-4e34-a3fb-ef2e51eecaca for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:02:22 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] Creating event network-vif-unplugged:d7199650-e2d2-4349-af5f-357b9f511835 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:02:22 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] Creating event network-vif-plugged:d7199650-e2d2-4349-af5f-357b9f511835 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:02:22 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.043819 Apr 13 23:02:22 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 163/487] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:02:22 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:02:23 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92"}, {"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-unplugged", "status": "completed", "tag": "7e8b103f-6a1d-41f9-aab0-8c17817026a5"}, {"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "7e8b103f-6a1d-41f9-aab0-8c17817026a5"}, {"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-unplugged", "status": "completed", "tag": "b5c60c56-d874-48fe-be4f-5dd41322809f"}, {"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "b5c60c56-d874-48fe-be4f-5dd41322809f"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:23 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Creating event network-vif-plugged:302fbc22-4c9a-48dc-bf40-4aec87dd4b92 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:02:23 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Creating event network-vif-unplugged:7e8b103f-6a1d-41f9-aab0-8c17817026a5 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:02:23 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Creating event network-vif-plugged:7e8b103f-6a1d-41f9-aab0-8c17817026a5 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:02:23 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Creating event network-vif-unplugged:b5c60c56-d874-48fe-be4f-5dd41322809f for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:02:23 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Creating event network-vif-plugged:b5c60c56-d874-48fe-be4f-5dd41322809f for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:02:23 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.041472 Apr 13 23:02:23 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 165/488] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:02:23 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:02:23 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-53dbfdfc-e1c8-45ef-914d-4a416c93dfd6 req-37a5f79c-9981-404f-aab0-5ca25214f3f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "5d649918-bdcb-4b16-b701-1dbad3722881"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-53dbfdfc-e1c8-45ef-914d-4a416c93dfd6 req-37a5f79c-9981-404f-aab0-5ca25214f3f5 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-53dbfdfc-e1c8-45ef-914d-4a416c93dfd6 req-37a5f79c-9981-404f-aab0-5ca25214f3f5 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-53dbfdfc-e1c8-45ef-914d-4a416c93dfd6 req-37a5f79c-9981-404f-aab0-5ca25214f3f5 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:23 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-53dbfdfc-e1c8-45ef-914d-4a416c93dfd6 req-37a5f79c-9981-404f-aab0-5ca25214f3f5 service nova] Creating event network-vif-plugged:5d649918-bdcb-4b16-b701-1dbad3722881 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:02:23 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-53dbfdfc-e1c8-45ef-914d-4a416c93dfd6 req-37a5f79c-9981-404f-aab0-5ca25214f3f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034971 Apr 13 23:02:23 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 161/489] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:02:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:02:24 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-8a446357-dfca-416c-9748-8e1830d717d5 req-616c51d5-eca0-4532-aeb5-103479c410c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-unplugged", "status": "completed", "tag": "20766522-a6dc-49b0-a925-09cbcce46937"}, {"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-plugged", "status": "completed", "tag": "20766522-a6dc-49b0-a925-09cbcce46937"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-8a446357-dfca-416c-9748-8e1830d717d5 req-616c51d5-eca0-4532-aeb5-103479c410c0 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-8a446357-dfca-416c-9748-8e1830d717d5 req-616c51d5-eca0-4532-aeb5-103479c410c0 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-8a446357-dfca-416c-9748-8e1830d717d5 req-616c51d5-eca0-4532-aeb5-103479c410c0 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:24 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-8a446357-dfca-416c-9748-8e1830d717d5 req-616c51d5-eca0-4532-aeb5-103479c410c0 service nova] Creating event network-vif-unplugged:20766522-a6dc-49b0-a925-09cbcce46937 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:02:24 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-8a446357-dfca-416c-9748-8e1830d717d5 req-616c51d5-eca0-4532-aeb5-103479c410c0 service nova] Creating event network-vif-plugged:20766522-a6dc-49b0-a925-09cbcce46937 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:02:24 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-8a446357-dfca-416c-9748-8e1830d717d5 req-616c51d5-eca0-4532-aeb5-103479c410c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030190 Apr 13 23:02:24 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 164/490] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:02:24 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:02:25 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:02:25 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:02:25 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-12c4ac8c-541b-452e-9221-4848d3ea70a9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:25 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-12c4ac8c-541b-452e-9221-4848d3ea70a9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-12c4ac8c-541b-452e-9221-4848d3ea70a9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-12c4ac8c-541b-452e-9221-4848d3ea70a9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-12c4ac8c-541b-452e-9221-4848d3ea70a9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-12c4ac8c-541b-452e-9221-4848d3ea70a9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-12c4ac8c-541b-452e-9221-4848d3ea70a9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-12c4ac8c-541b-452e-9221-4848d3ea70a9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:25 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-12c4ac8c-541b-452e-9221-4848d3ea70a9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051427 Apr 13 23:02:25 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 166/491] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:02:25 2023] GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 23:02:25 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:02:25 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:25 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:25 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:02:25 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b" status: 204 len: 0 microversion: 2.1 time: 0.127074 Apr 13 23:02:25 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 162/492] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:02:25 2023] DELETE /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:02:25 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-d52829d8-1b5c-425b-856c-38c9ebd4a5ed tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:25 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-d52829d8-1b5c-425b-856c-38c9ebd4a5ed tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d52829d8-1b5c-425b-856c-38c9ebd4a5ed tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d52829d8-1b5c-425b-856c-38c9ebd4a5ed tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d52829d8-1b5c-425b-856c-38c9ebd4a5ed tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d52829d8-1b5c-425b-856c-38c9ebd4a5ed tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d52829d8-1b5c-425b-856c-38c9ebd4a5ed tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d52829d8-1b5c-425b-856c-38c9ebd4a5ed tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:25 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-d52829d8-1b5c-425b-856c-38c9ebd4a5ed tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b46af525dd45678b69207e93683ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0648ea953174a8cae6085ac24d92bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:02:25 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-d52829d8-1b5c-425b-856c-38c9ebd4a5ed tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b" status: 200 len: 1658 microversion: 2.1 time: 0.248892 Apr 13 23:02:25 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 165/493] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:02:25 2023] GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b => generated 1658 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:02:26 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-ebb9c065-cfbf-46d4-bb15-e7d56eab7397 req-6a3d9c34-8062-4513-a84d-18f1d82b98ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-deleted", "tag": "d7199650-e2d2-4349-af5f-357b9f511835"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-ebb9c065-cfbf-46d4-bb15-e7d56eab7397 req-6a3d9c34-8062-4513-a84d-18f1d82b98ac service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-ebb9c065-cfbf-46d4-bb15-e7d56eab7397 req-6a3d9c34-8062-4513-a84d-18f1d82b98ac service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-ebb9c065-cfbf-46d4-bb15-e7d56eab7397 req-6a3d9c34-8062-4513-a84d-18f1d82b98ac service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:26 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-ebb9c065-cfbf-46d4-bb15-e7d56eab7397 req-6a3d9c34-8062-4513-a84d-18f1d82b98ac service nova] Creating event network-vif-deleted:d7199650-e2d2-4349-af5f-357b9f511835 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:02:26 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-ebb9c065-cfbf-46d4-bb15-e7d56eab7397 req-6a3d9c34-8062-4513-a84d-18f1d82b98ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040997 Apr 13 23:02:26 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 167/494] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:02:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:02:26 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-0b20e52e-aeac-4992-be16-1c77ae35561e req-461f67b1-94f5-48c6-9915-54a1205fabed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e1fa88-8896-4198-af4d-56d44baf3b9b", "name": "network-vif-unplugged", "status": "completed", "tag": "94c47f47-2ee7-46d0-858d-a5ff3270a80b"}, {"server_uuid": "92e1fa88-8896-4198-af4d-56d44baf3b9b", "name": "network-vif-plugged", "status": "completed", "tag": "94c47f47-2ee7-46d0-858d-a5ff3270a80b"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0b20e52e-aeac-4992-be16-1c77ae35561e req-461f67b1-94f5-48c6-9915-54a1205fabed service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0b20e52e-aeac-4992-be16-1c77ae35561e req-461f67b1-94f5-48c6-9915-54a1205fabed service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0b20e52e-aeac-4992-be16-1c77ae35561e req-461f67b1-94f5-48c6-9915-54a1205fabed service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-0b20e52e-aeac-4992-be16-1c77ae35561e req-461f67b1-94f5-48c6-9915-54a1205fabed service nova] Creating event network-vif-unplugged:94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b on user Apr 13 23:02:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-0b20e52e-aeac-4992-be16-1c77ae35561e req-461f67b1-94f5-48c6-9915-54a1205fabed service nova] Creating event network-vif-plugged:94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b on user Apr 13 23:02:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-0b20e52e-aeac-4992-be16-1c77ae35561e req-461f67b1-94f5-48c6-9915-54a1205fabed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.029018 Apr 13 23:02:26 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 163/495] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:02:26 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:02:28 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-b32cc642-9f80-4838-a05c-b104fa9a9c7e req-ec953348-658c-4e3c-82b0-3250b7bc9747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-deleted", "tag": "20766522-a6dc-49b0-a925-09cbcce46937"}, {"server_uuid": "92e1fa88-8896-4198-af4d-56d44baf3b9b", "name": "network-vif-deleted", "tag": "94c47f47-2ee7-46d0-858d-a5ff3270a80b"}, {"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-deleted", "tag": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b32cc642-9f80-4838-a05c-b104fa9a9c7e req-ec953348-658c-4e3c-82b0-3250b7bc9747 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b32cc642-9f80-4838-a05c-b104fa9a9c7e req-ec953348-658c-4e3c-82b0-3250b7bc9747 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b32cc642-9f80-4838-a05c-b104fa9a9c7e req-ec953348-658c-4e3c-82b0-3250b7bc9747 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:28 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-b32cc642-9f80-4838-a05c-b104fa9a9c7e req-ec953348-658c-4e3c-82b0-3250b7bc9747 service nova] Creating event network-vif-deleted:20766522-a6dc-49b0-a925-09cbcce46937 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:02:28 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-b32cc642-9f80-4838-a05c-b104fa9a9c7e req-ec953348-658c-4e3c-82b0-3250b7bc9747 service nova] Creating event network-vif-deleted:94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b on user Apr 13 23:02:28 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-b32cc642-9f80-4838-a05c-b104fa9a9c7e req-ec953348-658c-4e3c-82b0-3250b7bc9747 service nova] Creating event network-vif-deleted:302fbc22-4c9a-48dc-bf40-4aec87dd4b92 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:02:28 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-b32cc642-9f80-4838-a05c-b104fa9a9c7e req-ec953348-658c-4e3c-82b0-3250b7bc9747 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.037431 Apr 13 23:02:28 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 166/496] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:02:28 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:02:28 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-0e9e7ca2-1eda-4ab8-a9d7-5fd095a5de71 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:28 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-0e9e7ca2-1eda-4ab8-a9d7-5fd095a5de71 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0e9e7ca2-1eda-4ab8-a9d7-5fd095a5de71 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0e9e7ca2-1eda-4ab8-a9d7-5fd095a5de71 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0e9e7ca2-1eda-4ab8-a9d7-5fd095a5de71 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0e9e7ca2-1eda-4ab8-a9d7-5fd095a5de71 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0e9e7ca2-1eda-4ab8-a9d7-5fd095a5de71 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0e9e7ca2-1eda-4ab8-a9d7-5fd095a5de71 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:28 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-0e9e7ca2-1eda-4ab8-a9d7-5fd095a5de71 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053767 Apr 13 23:02:28 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 168/497] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:02:28 2023] GET /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 23:02:28 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:28 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:28 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:02:29 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91" status: 204 len: 0 microversion: 2.1 time: 0.130007 Apr 13 23:02:29 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 164/498] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:02:28 2023] DELETE /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:02:29 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-19eac3ca-157d-420e-adb8-884751bdd94f tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:29 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-19eac3ca-157d-420e-adb8-884751bdd94f tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-19eac3ca-157d-420e-adb8-884751bdd94f tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-19eac3ca-157d-420e-adb8-884751bdd94f tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-19eac3ca-157d-420e-adb8-884751bdd94f tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-19eac3ca-157d-420e-adb8-884751bdd94f tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-19eac3ca-157d-420e-adb8-884751bdd94f tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-19eac3ca-157d-420e-adb8-884751bdd94f tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:29 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-19eac3ca-157d-420e-adb8-884751bdd94f tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98594f3f6ccf4ffdbfd91bcf192d936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ccac99656842aca44f9f1eb7aa167a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:02:29 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-19eac3ca-157d-420e-adb8-884751bdd94f tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91" status: 200 len: 1670 microversion: 2.1 time: 0.320009 Apr 13 23:02:29 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 167/499] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:02:29 2023] GET /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91 => generated 1670 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:02:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-deleted", "tag": "7e8b103f-6a1d-41f9-aab0-8c17817026a5"}, {"server_uuid": "1783d976-5b1b-466b-abb1-fd4b5c9c01aa", "name": "network-vif-deleted", "tag": "b5c60c56-d874-48fe-be4f-5dd41322809f"}, {"server_uuid": "4435b0c4-7292-4348-bcd9-a712a2df3e91", "name": "network-vif-unplugged", "status": "completed", "tag": "79c62453-7ae2-480d-aa21-a5f26dfb0763"}, {"server_uuid": "4435b0c4-7292-4348-bcd9-a712a2df3e91", "name": "network-vif-plugged", "status": "completed", "tag": "79c62453-7ae2-480d-aa21-a5f26dfb0763"}, {"server_uuid": "4435b0c4-7292-4348-bcd9-a712a2df3e91", "name": "network-vif-plugged", "status": "completed", "tag": "79c62453-7ae2-480d-aa21-a5f26dfb0763"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:30 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] Creating event network-vif-deleted:7e8b103f-6a1d-41f9-aab0-8c17817026a5 for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:02:30 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] Creating event network-vif-deleted:b5c60c56-d874-48fe-be4f-5dd41322809f for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa on user Apr 13 23:02:30 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] Creating event network-vif-unplugged:79c62453-7ae2-480d-aa21-a5f26dfb0763 for instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 on user Apr 13 23:02:30 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] Creating event network-vif-plugged:79c62453-7ae2-480d-aa21-a5f26dfb0763 for instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 on user Apr 13 23:02:30 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] Creating event network-vif-plugged:79c62453-7ae2-480d-aa21-a5f26dfb0763 for instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 on user Apr 13 23:02:30 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.035267 Apr 13 23:02:30 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 169/500] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:02:30 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:02:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-9a15ef16-59aa-4383-b87c-8e247b044438 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:31 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-9a15ef16-59aa-4383-b87c-8e247b044438 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9a15ef16-59aa-4383-b87c-8e247b044438 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9a15ef16-59aa-4383-b87c-8e247b044438 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9a15ef16-59aa-4383-b87c-8e247b044438 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9a15ef16-59aa-4383-b87c-8e247b044438 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9a15ef16-59aa-4383-b87c-8e247b044438 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9a15ef16-59aa-4383-b87c-8e247b044438 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:31 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-9a15ef16-59aa-4383-b87c-8e247b044438 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] HTTP exception thrown: Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 could not be found. Apr 13 23:02:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-9a15ef16-59aa-4383-b87c-8e247b044438 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Request method failure captured: Apr 13 23:02:31 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6 HTTP/1.1 Apr 13 23:02:31 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:02:31 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:02:31 user devstack@n-api.service[61611]: Connection: close Apr 13 23:02:31 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:02:31 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:02:31 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:02:31 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:02:31 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIgE6Gl7ZSFkA-_Uvg9_1wPLldz_ScwHJLtH7XfCRP3AC2MJmMpZ7l9bcSBPK09rKumFcFKFuRTWt2Sf1d4N5k3NQaJGxn8JzsH44PLD5fzCs7WE6phnuUwwFlbCj4pm_qJgudGzAbO1tRiQjdcyEvfY3Ke0cXzXFHfEZxyouzAaMTk Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Project-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Project-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Tenant: tempest-TestVolumeBootPattern-751187467 Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Tenant-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:02:31 user devstack@n-api.service[61611]: X-User: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:02:31 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:02:31 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:02:31 user devstack@n-api.service[61611]: X-User-Id: b289294050af4c41aeef8401832487a1 Apr 13 23:02:31 user devstack@n-api.service[61611]: X-User-Name: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:02:31 user devstack@n-api.service[61611]: method: > Apr 13 23:02:31 user devstack@n-api.service[61611]: exception: Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 could not be found. Apr 13 23:02:31 user devstack@n-api.service[61611]: action_args: {'id': '05c9ae9c-47df-41c7-8805-f6fe22bf09d6'} Apr 13 23:02:31 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 could not be found. Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 could not be found. Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 could not be found. Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:02:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-9a15ef16-59aa-4383-b87c-8e247b044438 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Returning 404 to user: Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:02:31 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-9a15ef16-59aa-4383-b87c-8e247b044438 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6" status: 404 len: 111 microversion: 2.1 time: 0.030677 Apr 13 23:02:31 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 165/501] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:02:31 2023] GET /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:02:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-68b8c3d0-19c0-40de-9ac1-e04947d414d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:31 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-68b8c3d0-19c0-40de-9ac1-e04947d414d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-68b8c3d0-19c0-40de-9ac1-e04947d414d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-68b8c3d0-19c0-40de-9ac1-e04947d414d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-68b8c3d0-19c0-40de-9ac1-e04947d414d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-68b8c3d0-19c0-40de-9ac1-e04947d414d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-68b8c3d0-19c0-40de-9ac1-e04947d414d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-68b8c3d0-19c0-40de-9ac1-e04947d414d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:31 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-68b8c3d0-19c0-40de-9ac1-e04947d414d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] HTTP exception thrown: Instance bc51e254-7d38-49f6-816e-947d92f95950 could not be found. Apr 13 23:02:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-68b8c3d0-19c0-40de-9ac1-e04947d414d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Request method failure captured: Apr 13 23:02:31 user devstack@n-api.service[61612]: request: DELETE /compute/v2.1/servers/bc51e254-7d38-49f6-816e-947d92f95950 HTTP/1.1 Apr 13 23:02:31 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:02:31 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:02:31 user devstack@n-api.service[61612]: Connection: close Apr 13 23:02:31 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:02:31 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:02:31 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:02:31 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:02:31 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:02:31 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIgE6Gl7ZSFkA-_Uvg9_1wPLldz_ScwHJLtH7XfCRP3AC2MJmMpZ7l9bcSBPK09rKumFcFKFuRTWt2Sf1d4N5k3NQaJGxn8JzsH44PLD5fzCs7WE6phnuUwwFlbCj4pm_qJgudGzAbO1tRiQjdcyEvfY3Ke0cXzXFHfEZxyouzAaMTk Apr 13 23:02:31 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:02:31 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:02:31 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:02:31 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:02:31 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:02:31 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:02:31 user devstack@n-api.service[61612]: X-Project-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:02:31 user devstack@n-api.service[61612]: X-Project-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:02:31 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:02:31 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:02:31 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:02:31 user devstack@n-api.service[61612]: X-Tenant: tempest-TestVolumeBootPattern-751187467 Apr 13 23:02:31 user devstack@n-api.service[61612]: X-Tenant-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:02:31 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:02:31 user devstack@n-api.service[61612]: X-User: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:02:31 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:02:31 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:02:31 user devstack@n-api.service[61612]: X-User-Id: b289294050af4c41aeef8401832487a1 Apr 13 23:02:31 user devstack@n-api.service[61612]: X-User-Name: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:02:31 user devstack@n-api.service[61612]: method: > Apr 13 23:02:31 user devstack@n-api.service[61612]: exception: Instance bc51e254-7d38-49f6-816e-947d92f95950 could not be found. Apr 13 23:02:31 user devstack@n-api.service[61612]: action_args: {'id': 'bc51e254-7d38-49f6-816e-947d92f95950'} Apr 13 23:02:31 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc51e254-7d38-49f6-816e-947d92f95950 could not be found. Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc51e254-7d38-49f6-816e-947d92f95950 could not be found. Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc51e254-7d38-49f6-816e-947d92f95950 could not be found. Apr 13 23:02:31 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:02:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-68b8c3d0-19c0-40de-9ac1-e04947d414d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Returning 404 to user: Instance bc51e254-7d38-49f6-816e-947d92f95950 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:02:31 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-68b8c3d0-19c0-40de-9ac1-e04947d414d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bc51e254-7d38-49f6-816e-947d92f95950" status: 404 len: 111 microversion: 2.1 time: 0.033693 Apr 13 23:02:31 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 168/502] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:02:31 2023] DELETE /compute/v2.1/servers/bc51e254-7d38-49f6-816e-947d92f95950 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:02:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-1a18296c-8abf-440a-941f-419864e2a0af tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:31 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-1a18296c-8abf-440a-941f-419864e2a0af tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a18296c-8abf-440a-941f-419864e2a0af tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a18296c-8abf-440a-941f-419864e2a0af tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a18296c-8abf-440a-941f-419864e2a0af tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a18296c-8abf-440a-941f-419864e2a0af tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a18296c-8abf-440a-941f-419864e2a0af tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a18296c-8abf-440a-941f-419864e2a0af tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:31 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-1a18296c-8abf-440a-941f-419864e2a0af tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] HTTP exception thrown: Instance bc51e254-7d38-49f6-816e-947d92f95950 could not be found. Apr 13 23:02:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-1a18296c-8abf-440a-941f-419864e2a0af tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Request method failure captured: Apr 13 23:02:31 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/bc51e254-7d38-49f6-816e-947d92f95950 HTTP/1.1 Apr 13 23:02:31 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:02:31 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:02:31 user devstack@n-api.service[61613]: Connection: close Apr 13 23:02:31 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:02:31 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:02:31 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:02:31 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:02:31 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:02:31 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIgE6Gl7ZSFkA-_Uvg9_1wPLldz_ScwHJLtH7XfCRP3AC2MJmMpZ7l9bcSBPK09rKumFcFKFuRTWt2Sf1d4N5k3NQaJGxn8JzsH44PLD5fzCs7WE6phnuUwwFlbCj4pm_qJgudGzAbO1tRiQjdcyEvfY3Ke0cXzXFHfEZxyouzAaMTk Apr 13 23:02:31 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:02:31 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:02:31 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:02:31 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:02:31 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:02:31 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:02:31 user devstack@n-api.service[61613]: X-Project-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:02:31 user devstack@n-api.service[61613]: X-Project-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:02:31 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:02:31 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:02:31 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:02:31 user devstack@n-api.service[61613]: X-Tenant: tempest-TestVolumeBootPattern-751187467 Apr 13 23:02:31 user devstack@n-api.service[61613]: X-Tenant-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:02:31 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:02:31 user devstack@n-api.service[61613]: X-User: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:02:31 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:02:31 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:02:31 user devstack@n-api.service[61613]: X-User-Id: b289294050af4c41aeef8401832487a1 Apr 13 23:02:31 user devstack@n-api.service[61613]: X-User-Name: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:02:31 user devstack@n-api.service[61613]: method: > Apr 13 23:02:31 user devstack@n-api.service[61613]: exception: Instance bc51e254-7d38-49f6-816e-947d92f95950 could not be found. Apr 13 23:02:31 user devstack@n-api.service[61613]: action_args: {'id': 'bc51e254-7d38-49f6-816e-947d92f95950'} Apr 13 23:02:31 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc51e254-7d38-49f6-816e-947d92f95950 could not be found. Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc51e254-7d38-49f6-816e-947d92f95950 could not be found. Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc51e254-7d38-49f6-816e-947d92f95950 could not be found. Apr 13 23:02:31 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:02:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-1a18296c-8abf-440a-941f-419864e2a0af tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Returning 404 to user: Instance bc51e254-7d38-49f6-816e-947d92f95950 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:02:31 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-1a18296c-8abf-440a-941f-419864e2a0af tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc51e254-7d38-49f6-816e-947d92f95950" status: 404 len: 111 microversion: 2.1 time: 0.029104 Apr 13 23:02:31 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 170/503] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:02:31 2023] GET /compute/v2.1/servers/bc51e254-7d38-49f6-816e-947d92f95950 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:02:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f4edb639-f8c1-48ef-b083-48d3c833a5d4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:31 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f4edb639-f8c1-48ef-b083-48d3c833a5d4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f4edb639-f8c1-48ef-b083-48d3c833a5d4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f4edb639-f8c1-48ef-b083-48d3c833a5d4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f4edb639-f8c1-48ef-b083-48d3c833a5d4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f4edb639-f8c1-48ef-b083-48d3c833a5d4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f4edb639-f8c1-48ef-b083-48d3c833a5d4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f4edb639-f8c1-48ef-b083-48d3c833a5d4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:31 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-f4edb639-f8c1-48ef-b083-48d3c833a5d4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] HTTP exception thrown: Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 could not be found. Apr 13 23:02:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f4edb639-f8c1-48ef-b083-48d3c833a5d4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Request method failure captured: Apr 13 23:02:31 user devstack@n-api.service[61611]: request: DELETE /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6 HTTP/1.1 Apr 13 23:02:31 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:02:31 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:02:31 user devstack@n-api.service[61611]: Connection: close Apr 13 23:02:31 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:02:31 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:02:31 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:02:31 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:02:31 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIgE6Gl7ZSFkA-_Uvg9_1wPLldz_ScwHJLtH7XfCRP3AC2MJmMpZ7l9bcSBPK09rKumFcFKFuRTWt2Sf1d4N5k3NQaJGxn8JzsH44PLD5fzCs7WE6phnuUwwFlbCj4pm_qJgudGzAbO1tRiQjdcyEvfY3Ke0cXzXFHfEZxyouzAaMTk Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Project-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Project-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Tenant: tempest-TestVolumeBootPattern-751187467 Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Tenant-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:02:31 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:02:31 user devstack@n-api.service[61611]: X-User: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:02:31 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:02:31 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:02:31 user devstack@n-api.service[61611]: X-User-Id: b289294050af4c41aeef8401832487a1 Apr 13 23:02:31 user devstack@n-api.service[61611]: X-User-Name: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:02:31 user devstack@n-api.service[61611]: method: > Apr 13 23:02:31 user devstack@n-api.service[61611]: exception: Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 could not be found. Apr 13 23:02:31 user devstack@n-api.service[61611]: action_args: {'id': '05c9ae9c-47df-41c7-8805-f6fe22bf09d6'} Apr 13 23:02:31 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 could not be found. Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 could not be found. Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 could not be found. Apr 13 23:02:31 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:02:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f4edb639-f8c1-48ef-b083-48d3c833a5d4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Returning 404 to user: Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:02:31 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f4edb639-f8c1-48ef-b083-48d3c833a5d4 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6" status: 404 len: 111 microversion: 2.1 time: 0.042385 Apr 13 23:02:31 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 166/504] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:02:31 2023] DELETE /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:02:32 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-5e93a430-d690-4d53-be13-dc85f3b71297 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:32 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-5e93a430-d690-4d53-be13-dc85f3b71297 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5e93a430-d690-4d53-be13-dc85f3b71297 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5e93a430-d690-4d53-be13-dc85f3b71297 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5e93a430-d690-4d53-be13-dc85f3b71297 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5e93a430-d690-4d53-be13-dc85f3b71297 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5e93a430-d690-4d53-be13-dc85f3b71297 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5e93a430-d690-4d53-be13-dc85f3b71297 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:32 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-5e93a430-d690-4d53-be13-dc85f3b71297 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] HTTP exception thrown: Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 could not be found. Apr 13 23:02:32 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-5e93a430-d690-4d53-be13-dc85f3b71297 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Request method failure captured: Apr 13 23:02:32 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6 HTTP/1.1 Apr 13 23:02:32 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:02:32 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:02:32 user devstack@n-api.service[61612]: Connection: close Apr 13 23:02:32 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:02:32 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:02:32 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:02:32 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:02:32 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:02:32 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIgE6Gl7ZSFkA-_Uvg9_1wPLldz_ScwHJLtH7XfCRP3AC2MJmMpZ7l9bcSBPK09rKumFcFKFuRTWt2Sf1d4N5k3NQaJGxn8JzsH44PLD5fzCs7WE6phnuUwwFlbCj4pm_qJgudGzAbO1tRiQjdcyEvfY3Ke0cXzXFHfEZxyouzAaMTk Apr 13 23:02:32 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:02:32 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:02:32 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:02:32 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:02:32 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:02:32 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:02:32 user devstack@n-api.service[61612]: X-Project-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:02:32 user devstack@n-api.service[61612]: X-Project-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:02:32 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:02:32 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:02:32 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:02:32 user devstack@n-api.service[61612]: X-Tenant: tempest-TestVolumeBootPattern-751187467 Apr 13 23:02:32 user devstack@n-api.service[61612]: X-Tenant-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:02:32 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:02:32 user devstack@n-api.service[61612]: X-User: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:02:32 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:02:32 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:02:32 user devstack@n-api.service[61612]: X-User-Id: b289294050af4c41aeef8401832487a1 Apr 13 23:02:32 user devstack@n-api.service[61612]: X-User-Name: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:02:32 user devstack@n-api.service[61612]: method: > Apr 13 23:02:32 user devstack@n-api.service[61612]: exception: Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 could not be found. Apr 13 23:02:32 user devstack@n-api.service[61612]: action_args: {'id': '05c9ae9c-47df-41c7-8805-f6fe22bf09d6'} Apr 13 23:02:32 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 could not be found. Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 could not be found. Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 could not be found. Apr 13 23:02:32 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:02:32 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-5e93a430-d690-4d53-be13-dc85f3b71297 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Returning 404 to user: Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:02:32 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-5e93a430-d690-4d53-be13-dc85f3b71297 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6" status: 404 len: 111 microversion: 2.1 time: 0.051631 Apr 13 23:02:32 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 169/505] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:02:31 2023] GET /compute/v2.1/servers/05c9ae9c-47df-41c7-8805-f6fe22bf09d6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:02:32 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-cf9da8ef-2336-49ea-bc88-27c03ac62aef tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Action: 'create', calling method: .version_select at 0x7f3d1de76b00>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-408481084", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8CZA5RghKz7K8Y+9yZj2ETI4xi2zuLToUWaLxjWoaX6IAWaiUhjHsm0FDZwmMUQXZa4WFnJ4hfzQyNTjxOtNUh6s5QP9ZWSYC8B80ZF366UkoREr402Yb3H4RlLm3SjQ=="}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:32 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-cf9da8ef-2336-49ea-bc88-27c03ac62aef tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting quotas for project d872848d5dc1471996e2f33bbbdebbd9. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:02:32 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-cf9da8ef-2336-49ea-bc88-27c03ac62aef tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting quotas for user b289294050af4c41aeef8401832487a1 and project d872848d5dc1471996e2f33bbbdebbd9. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:02:32 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-cf9da8ef-2336-49ea-bc88-27c03ac62aef tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.079840 Apr 13 23:02:32 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 171/506] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 23:02:32 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:02:32 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4435b0c4-7292-4348-bcd9-a712a2df3e91", "name": "network-vif-plugged", "status": "completed", "tag": "79c62453-7ae2-480d-aa21-a5f26dfb0763"}, {"server_uuid": "4435b0c4-7292-4348-bcd9-a712a2df3e91", "name": "network-vif-unplugged", "status": "completed", "tag": "79c62453-7ae2-480d-aa21-a5f26dfb0763"}, {"server_uuid": "4435b0c4-7292-4348-bcd9-a712a2df3e91", "name": "network-vif-plugged", "status": "completed", "tag": "79c62453-7ae2-480d-aa21-a5f26dfb0763"}, {"server_uuid": "4435b0c4-7292-4348-bcd9-a712a2df3e91", "name": "network-vif-deleted", "tag": "79c62453-7ae2-480d-aa21-a5f26dfb0763"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:32 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] Creating event network-vif-plugged:79c62453-7ae2-480d-aa21-a5f26dfb0763 for instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 on user Apr 13 23:02:32 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] Creating event network-vif-unplugged:79c62453-7ae2-480d-aa21-a5f26dfb0763 for instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 on user Apr 13 23:02:32 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] Creating event network-vif-plugged:79c62453-7ae2-480d-aa21-a5f26dfb0763 for instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 on user Apr 13 23:02:32 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] Creating event network-vif-deleted:79c62453-7ae2-480d-aa21-a5f26dfb0763 for instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 on user Apr 13 23:02:32 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.040511 Apr 13 23:02:32 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 167/507] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:02:32 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 23:02:37 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2073414277", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-408481084", "security_groups": [{"name": "tempest-secgroup-smoke-320997561"}], "block_device_mapping_v2": [{"uuid": "7e14d684-74a4-43e0-aa03-5dc4d626d990", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aadb940e-808f-4d62-87fe-765d072b7c2f"}]}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:37 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] validate_networks() for [('aadb940e-808f-4d62-87fe-765d072b7c2f', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:02:38 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:02:38 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:02:38 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:02:38 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:02:38 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:02:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:38 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting quotas for project d872848d5dc1471996e2f33bbbdebbd9. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:02:38 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting quotas for user b289294050af4c41aeef8401832487a1 and project d872848d5dc1471996e2f33bbbdebbd9. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:02:38 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:02:38 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7e14d684-74a4-43e0-aa03-5dc4d626d990',volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:02:38 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.197337 Apr 13 23:02:38 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 170/508] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:02:37 2023] POST /compute/v2.1/servers => generated 403 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:02:38 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-307ab79f-5a7c-403f-b832-d177b060c55b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:38 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-307ab79f-5a7c-403f-b832-d177b060c55b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:39 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-307ab79f-5a7c-403f-b832-d177b060c55b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:02:39 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-307ab79f-5a7c-403f-b832-d177b060c55b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06ecf305-65ca-4752-984c-cb7094593493" status: 200 len: 1089 microversion: 2.1 time: 0.067467 Apr 13 23:02:39 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 172/509] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:02:38 2023] GET /compute/v2.1/servers/06ecf305-65ca-4752-984c-cb7094593493 => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:02:41 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-8f516329-bf7f-4ec5-9a89-a6f9d0365395 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:41 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-8f516329-bf7f-4ec5-9a89-a6f9d0365395 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:41 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=3 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:02:41 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-abeff579-ee22-4141-9c41-6f91bb8c652c req-2057a200-e59f-477f-861c-a053c948aba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06ecf305-65ca-4752-984c-cb7094593493", "tag": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8f516329-bf7f-4ec5-9a89-a6f9d0365395 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8f516329-bf7f-4ec5-9a89-a6f9d0365395 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8f516329-bf7f-4ec5-9a89-a6f9d0365395 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8f516329-bf7f-4ec5-9a89-a6f9d0365395 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8f516329-bf7f-4ec5-9a89-a6f9d0365395 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8f516329-bf7f-4ec5-9a89-a6f9d0365395 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:41 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:02:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-abeff579-ee22-4141-9c41-6f91bb8c652c req-2057a200-e59f-477f-861c-a053c948aba4 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-abeff579-ee22-4141-9c41-6f91bb8c652c req-2057a200-e59f-477f-861c-a053c948aba4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-abeff579-ee22-4141-9c41-6f91bb8c652c req-2057a200-e59f-477f-861c-a053c948aba4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:41 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-8f516329-bf7f-4ec5-9a89-a6f9d0365395 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] HTTP exception thrown: Instance b190941d-9f62-41ef-881d-e02d246e9138 could not be found. Apr 13 23:02:41 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-8f516329-bf7f-4ec5-9a89-a6f9d0365395 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Request method failure captured: Apr 13 23:02:41 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138 HTTP/1.1 Apr 13 23:02:41 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:02:41 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:02:41 user devstack@n-api.service[61611]: Connection: close Apr 13 23:02:41 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:02:41 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:02:41 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:02:41 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:02:41 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:02:41 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIiqmOc_jLwesAQk99mPpAwX4yPkvI4gxc0CX79zo2U49YpOkE1P1Vgrgx0AIOV4uSWhOhTpAt3ClJ1sc2omO3e6uzmuNuDjNfjdF-ljuOMYFVYPTVI7GUSixFeXrIvRxQWRt5GRaZsPC5aFcdH4Eq-k5brL5De7wLsJ-zubuNON-es Apr 13 23:02:41 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:02:41 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:02:41 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:02:41 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:02:41 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:02:41 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:02:41 user devstack@n-api.service[61611]: X-Project-Id: cf532d1c87a34b8cbde0f162688f7cdb Apr 13 23:02:41 user devstack@n-api.service[61611]: X-Project-Name: tempest-TestMinimumBasicScenario-146514025 Apr 13 23:02:41 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:02:41 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:02:41 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf532d1c87a34b8cbde0f162688f7cdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf532d1c87a34b8cbde0f162688f7cdb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf532d1c87a34b8cbde0f162688f7cdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:02:41 user devstack@n-api.service[61611]: X-Tenant: tempest-TestMinimumBasicScenario-146514025 Apr 13 23:02:41 user devstack@n-api.service[61611]: X-Tenant-Id: cf532d1c87a34b8cbde0f162688f7cdb Apr 13 23:02:41 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-TestMinimumBasicScenario-146514025 Apr 13 23:02:41 user devstack@n-api.service[61611]: X-User: tempest-TestMinimumBasicScenario-146514025-project-member Apr 13 23:02:41 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:02:41 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:02:41 user devstack@n-api.service[61611]: X-User-Id: fad76e3a6e154feaa62d95f6e7d1ce1c Apr 13 23:02:41 user devstack@n-api.service[61611]: X-User-Name: tempest-TestMinimumBasicScenario-146514025-project-member Apr 13 23:02:41 user devstack@n-api.service[61611]: method: > Apr 13 23:02:41 user devstack@n-api.service[61611]: exception: Instance b190941d-9f62-41ef-881d-e02d246e9138 could not be found. Apr 13 23:02:41 user devstack@n-api.service[61611]: action_args: {'id': 'b190941d-9f62-41ef-881d-e02d246e9138'} Apr 13 23:02:41 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b190941d-9f62-41ef-881d-e02d246e9138 could not be found. Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b190941d-9f62-41ef-881d-e02d246e9138 could not be found. Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b190941d-9f62-41ef-881d-e02d246e9138 could not be found. Apr 13 23:02:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:02:41 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-8f516329-bf7f-4ec5-9a89-a6f9d0365395 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Returning 404 to user: Instance b190941d-9f62-41ef-881d-e02d246e9138 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:02:41 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-8f516329-bf7f-4ec5-9a89-a6f9d0365395 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138" status: 404 len: 111 microversion: 2.1 time: 0.042430 Apr 13 23:02:41 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 168/510] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:02:41 2023] GET /compute/v2.1/servers/b190941d-9f62-41ef-881d-e02d246e9138 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:02:41 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-abeff579-ee22-4141-9c41-6f91bb8c652c req-2057a200-e59f-477f-861c-a053c948aba4 service nova] Creating event network-changed:e6bb2fdf-5afa-4160-b657-34c1bafa0b23 for instance 06ecf305-65ca-4752-984c-cb7094593493 on user Apr 13 23:02:41 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-6df79509-e8ac-4507-9ec3-946231c3b809 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '.version_select at 0x7f3d1de77910>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:41 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-abeff579-ee22-4141-9c41-6f91bb8c652c req-2057a200-e59f-477f-861c-a053c948aba4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045038 Apr 13 23:02:41 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 171/511] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:02:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:02:41 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-6df79509-e8ac-4507-9ec3-946231c3b809 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1486131087" status: 202 len: 0 microversion: 2.1 time: 0.023656 Apr 13 23:02:41 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 173/512] 10.0.0.210 () {62 vars in 1349 bytes} [Thu Apr 13 23:02:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1486131087 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:02:44 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c8377e18-891d-4ee5-ae42-3858ed84a60c tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Action: 'create', calling method: .version_select at 0x7f3d1c504ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1134301175", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4sGHCLoLvO1a6S/Zt/PEdT7BPKf9ERdMM0FJv9xWt+SMt3ws6LpVhbc/hXC0h4+aCtYPmwhyCNg25B0Fn+l5Ab22CCK9eEL6zQEp3JGKV2S3bXOgj0WJVeX+40Z2Y9eg=="}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:44 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-c8377e18-891d-4ee5-ae42-3858ed84a60c tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Getting quotas for project cf532d1c87a34b8cbde0f162688f7cdb. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:02:44 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-c8377e18-891d-4ee5-ae42-3858ed84a60c tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Getting quotas for user fad76e3a6e154feaa62d95f6e7d1ce1c and project cf532d1c87a34b8cbde0f162688f7cdb. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:02:44 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-c8377e18-891d-4ee5-ae42-3858ed84a60c tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055313 Apr 13 23:02:44 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 169/513] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 23:02:44 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:02:44 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-663169904", "imageRef": "0e299bea-bdd5-4988-a5dc-230b7bdfa5d3", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1134301175", "networks": [{"uuid": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a"}]}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:44 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:02:44 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] validate_networks() for [('31c239a4-3745-4a30-8ac2-820d7bdc9e2a', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:02:44 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:02:44 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:02:44 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:02:44 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:02:44 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:02:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:44 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=49 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:02:44 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Getting quotas for project cf532d1c87a34b8cbde0f162688f7cdb. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:02:44 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Getting quotas for user fad76e3a6e154feaa62d95f6e7d1ce1c and project cf532d1c87a34b8cbde0f162688f7cdb. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:02:44 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:02:44 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0e299bea-bdd5-4988-a5dc-230b7bdfa5d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:02:44 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.507090 Apr 13 23:02:44 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 172/514] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:02:44 2023] POST /compute/v2.1/servers => generated 378 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:02:44 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=36 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:02:44 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-addcfa8c-7df3-4ef3-ad6a-8b3f0ccd52e3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:02:44 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-addcfa8c-7df3-4ef3-ad6a-8b3f0ccd52e3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:02:44 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:02:44 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-addcfa8c-7df3-4ef3-ad6a-8b3f0ccd52e3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:02:44 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-addcfa8c-7df3-4ef3-ad6a-8b3f0ccd52e3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2" status: 200 len: 1252 microversion: 2.1 time: 0.080286 Apr 13 23:02:44 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 174/515] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:02:44 2023] GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2 => generated 1252 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:02:47 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-e012813d-317e-46b9-b2f7-32a1743a3688 req-9171890f-e74e-475b-b209-0127b71daaa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c7e35a-9a30-44ff-bb5f-74d122bf08d2", "tag": "95b6eed4-ff6e-493e-a912-d263def87a82"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-e012813d-317e-46b9-b2f7-32a1743a3688 req-9171890f-e74e-475b-b209-0127b71daaa7 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-e012813d-317e-46b9-b2f7-32a1743a3688 req-9171890f-e74e-475b-b209-0127b71daaa7 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-e012813d-317e-46b9-b2f7-32a1743a3688 req-9171890f-e74e-475b-b209-0127b71daaa7 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:47 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-e012813d-317e-46b9-b2f7-32a1743a3688 req-9171890f-e74e-475b-b209-0127b71daaa7 service nova] Creating event network-changed:95b6eed4-ff6e-493e-a912-d263def87a82 for instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 on user Apr 13 23:02:47 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-e012813d-317e-46b9-b2f7-32a1743a3688 req-9171890f-e74e-475b-b209-0127b71daaa7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031560 Apr 13 23:02:47 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 170/516] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:02:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 23:02:49 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-51a4bc62-6f5f-4b37-846c-a98ae335ef42 req-161aa46f-3608-4f2a-a28b-7a036452ed8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06ecf305-65ca-4752-984c-cb7094593493", "name": "network-vif-plugged", "status": "completed", "tag": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23"}, {"server_uuid": "06ecf305-65ca-4752-984c-cb7094593493", "name": "network-vif-plugged", "status": "completed", "tag": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-51a4bc62-6f5f-4b37-846c-a98ae335ef42 req-161aa46f-3608-4f2a-a28b-7a036452ed8b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-51a4bc62-6f5f-4b37-846c-a98ae335ef42 req-161aa46f-3608-4f2a-a28b-7a036452ed8b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-51a4bc62-6f5f-4b37-846c-a98ae335ef42 req-161aa46f-3608-4f2a-a28b-7a036452ed8b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:49 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-51a4bc62-6f5f-4b37-846c-a98ae335ef42 req-161aa46f-3608-4f2a-a28b-7a036452ed8b service nova] Creating event network-vif-plugged:e6bb2fdf-5afa-4160-b657-34c1bafa0b23 for instance 06ecf305-65ca-4752-984c-cb7094593493 on user Apr 13 23:02:49 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-51a4bc62-6f5f-4b37-846c-a98ae335ef42 req-161aa46f-3608-4f2a-a28b-7a036452ed8b service nova] Creating event network-vif-plugged:e6bb2fdf-5afa-4160-b657-34c1bafa0b23 for instance 06ecf305-65ca-4752-984c-cb7094593493 on user Apr 13 23:02:49 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-51a4bc62-6f5f-4b37-846c-a98ae335ef42 req-161aa46f-3608-4f2a-a28b-7a036452ed8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028806 Apr 13 23:02:49 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 173/517] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:02:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:02:49 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-1aff6a47-af87-438f-afe1-3258c6c32271 req-859e9d0b-df3a-437e-adc6-7293cc3d9b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c7e35a-9a30-44ff-bb5f-74d122bf08d2", "name": "network-vif-plugged", "status": "completed", "tag": "95b6eed4-ff6e-493e-a912-d263def87a82"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1aff6a47-af87-438f-afe1-3258c6c32271 req-859e9d0b-df3a-437e-adc6-7293cc3d9b83 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1aff6a47-af87-438f-afe1-3258c6c32271 req-859e9d0b-df3a-437e-adc6-7293cc3d9b83 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1aff6a47-af87-438f-afe1-3258c6c32271 req-859e9d0b-df3a-437e-adc6-7293cc3d9b83 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:49 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-1aff6a47-af87-438f-afe1-3258c6c32271 req-859e9d0b-df3a-437e-adc6-7293cc3d9b83 service nova] Creating event network-vif-plugged:95b6eed4-ff6e-493e-a912-d263def87a82 for instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 on user Apr 13 23:02:49 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-1aff6a47-af87-438f-afe1-3258c6c32271 req-859e9d0b-df3a-437e-adc6-7293cc3d9b83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035036 Apr 13 23:02:49 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 175/518] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:02:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:02:51 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-6db21428-73b8-4f71-a474-5fdc3bba7f71 req-2a596a9f-4388-4185-a6cb-03321c7f25f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c7e35a-9a30-44ff-bb5f-74d122bf08d2", "name": "network-vif-plugged", "status": "completed", "tag": "95b6eed4-ff6e-493e-a912-d263def87a82"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:02:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-6db21428-73b8-4f71-a474-5fdc3bba7f71 req-2a596a9f-4388-4185-a6cb-03321c7f25f8 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:02:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-6db21428-73b8-4f71-a474-5fdc3bba7f71 req-2a596a9f-4388-4185-a6cb-03321c7f25f8 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:02:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-6db21428-73b8-4f71-a474-5fdc3bba7f71 req-2a596a9f-4388-4185-a6cb-03321c7f25f8 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:02:51 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-6db21428-73b8-4f71-a474-5fdc3bba7f71 req-2a596a9f-4388-4185-a6cb-03321c7f25f8 service nova] Creating event network-vif-plugged:95b6eed4-ff6e-493e-a912-d263def87a82 for instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 on user Apr 13 23:02:51 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-6db21428-73b8-4f71-a474-5fdc3bba7f71 req-2a596a9f-4388-4185-a6cb-03321c7f25f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030405 Apr 13 23:02:51 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 171/519] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:02:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:03:04 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:03:04 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=12 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:03:04 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:03:04 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:03:04 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-734dc94b-f9d7-43b0-9477-cc3ebd12ad67 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:03:04 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-734dc94b-f9d7-43b0-9477-cc3ebd12ad67 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:03:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-734dc94b-f9d7-43b0-9477-cc3ebd12ad67 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-734dc94b-f9d7-43b0-9477-cc3ebd12ad67 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-734dc94b-f9d7-43b0-9477-cc3ebd12ad67 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-734dc94b-f9d7-43b0-9477-cc3ebd12ad67 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-734dc94b-f9d7-43b0-9477-cc3ebd12ad67 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-734dc94b-f9d7-43b0-9477-cc3ebd12ad67 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:04 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-734dc94b-f9d7-43b0-9477-cc3ebd12ad67 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71593deacbd74fea9fc2faf5a9b08877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a3c684b0414336b2ca770eb1f3ab17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:03:04 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-734dc94b-f9d7-43b0-9477-cc3ebd12ad67 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc473fb8-e574-4e49-b860-3ae0066cc9b8" status: 200 len: 1491 microversion: 2.1 time: 0.255238 Apr 13 23:03:04 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 174/520] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:03:04 2023] GET /compute/v2.1/servers/dc473fb8-e574-4e49-b860-3ae0066cc9b8 => generated 1491 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:03:09 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=8 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:03:09 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=5 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:03:09 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:03:09 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:03:09 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:03:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:09 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:03:09 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a2979e2c-7ef9-4cbd-8daf-dedd5103f857" status: 204 len: 0 microversion: 2.1 time: 0.258561 Apr 13 23:03:09 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 176/521] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:03:09 2023] DELETE /compute/v2.1/servers/a2979e2c-7ef9-4cbd-8daf-dedd5103f857 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:03:09 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:03:09 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:03:09 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=5 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:03:09 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d02940aa-17c5-4d1c-af0b-7ee2218dcd57 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:03:09 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-d02940aa-17c5-4d1c-af0b-7ee2218dcd57 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:03:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d02940aa-17c5-4d1c-af0b-7ee2218dcd57 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d02940aa-17c5-4d1c-af0b-7ee2218dcd57 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d02940aa-17c5-4d1c-af0b-7ee2218dcd57 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d02940aa-17c5-4d1c-af0b-7ee2218dcd57 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d02940aa-17c5-4d1c-af0b-7ee2218dcd57 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d02940aa-17c5-4d1c-af0b-7ee2218dcd57 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:09 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-d02940aa-17c5-4d1c-af0b-7ee2218dcd57 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eea00459cc046129decc442a6996ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea52ea14393449b3b0ce5a8ed973e435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:03:09 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-d02940aa-17c5-4d1c-af0b-7ee2218dcd57 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2979e2c-7ef9-4cbd-8daf-dedd5103f857" status: 200 len: 1459 microversion: 2.1 time: 0.238017 Apr 13 23:03:09 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 172/522] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:03:09 2023] GET /compute/v2.1/servers/a2979e2c-7ef9-4cbd-8daf-dedd5103f857 => generated 1459 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:03:09 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-7df4b8a2-efd1-4514-b6bc-3fd8ee1a0da3 req-e0e784b2-8e4b-49d3-9e9c-91231376081b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2979e2c-7ef9-4cbd-8daf-dedd5103f857", "name": "network-vif-unplugged", "status": "completed", "tag": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7df4b8a2-efd1-4514-b6bc-3fd8ee1a0da3 req-e0e784b2-8e4b-49d3-9e9c-91231376081b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7df4b8a2-efd1-4514-b6bc-3fd8ee1a0da3 req-e0e784b2-8e4b-49d3-9e9c-91231376081b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7df4b8a2-efd1-4514-b6bc-3fd8ee1a0da3 req-e0e784b2-8e4b-49d3-9e9c-91231376081b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:09 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-7df4b8a2-efd1-4514-b6bc-3fd8ee1a0da3 req-e0e784b2-8e4b-49d3-9e9c-91231376081b service nova] Creating event network-vif-unplugged:5f5f289c-7a04-41f3-b5e8-73e45d3ac536 for instance a2979e2c-7ef9-4cbd-8daf-dedd5103f857 on user Apr 13 23:03:09 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-7df4b8a2-efd1-4514-b6bc-3fd8ee1a0da3 req-e0e784b2-8e4b-49d3-9e9c-91231376081b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103284 Apr 13 23:03:09 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 175/523] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:03:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:03:11 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-26ee8e87-65db-40fc-a520-a46f1a53215f tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:03:11 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-26ee8e87-65db-40fc-a520-a46f1a53215f tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:03:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-26ee8e87-65db-40fc-a520-a46f1a53215f tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-26ee8e87-65db-40fc-a520-a46f1a53215f tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-26ee8e87-65db-40fc-a520-a46f1a53215f tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-26ee8e87-65db-40fc-a520-a46f1a53215f tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-26ee8e87-65db-40fc-a520-a46f1a53215f tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-26ee8e87-65db-40fc-a520-a46f1a53215f tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:11 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-26ee8e87-65db-40fc-a520-a46f1a53215f tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] HTTP exception thrown: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. Apr 13 23:03:11 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-26ee8e87-65db-40fc-a520-a46f1a53215f tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Request method failure captured: Apr 13 23:03:11 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa HTTP/1.1 Apr 13 23:03:11 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:03:11 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:03:11 user devstack@n-api.service[61613]: Connection: close Apr 13 23:03:11 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:03:11 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:03:11 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:03:11 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:03:11 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:03:11 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIl0CV1I3Uof6WdrWw4mi_5bkV_2aEbU1qRi7gC_-t09TWwaBXkPRiq96vuQVtfuIRzuSTObPCCZd6nz5d3Dbv85Ki6lzsennodx_qxb8TsCwXmQIH_X6FxY_wDspiwqFpvlhH09DVO5L01vGWCRwVgey3M_wu27_sVrYiSW5uJpQzw Apr 13 23:03:11 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:03:11 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:03:11 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:03:11 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:03:11 user devstack@n-api.service[61613]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 23:03:11 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:03:11 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:03:11 user devstack@n-api.service[61613]: X-Project-Id: a3774169387c4fc59f3300af1a033087 Apr 13 23:03:11 user devstack@n-api.service[61613]: X-Project-Name: tempest-TaggedBootDevicesTest-2028021468 Apr 13 23:03:11 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:03:11 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:03:11 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a3774169387c4fc59f3300af1a033087"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a3774169387c4fc59f3300af1a033087"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a3774169387c4fc59f3300af1a033087"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:03:11 user devstack@n-api.service[61613]: X-Tenant: tempest-TaggedBootDevicesTest-2028021468 Apr 13 23:03:11 user devstack@n-api.service[61613]: X-Tenant-Id: a3774169387c4fc59f3300af1a033087 Apr 13 23:03:11 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2028021468 Apr 13 23:03:11 user devstack@n-api.service[61613]: X-User: tempest-TaggedBootDevicesTest-2028021468-project-member Apr 13 23:03:11 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:03:11 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:03:11 user devstack@n-api.service[61613]: X-User-Id: c16f28e6923c4fbfbb3c295377b6f9d8 Apr 13 23:03:11 user devstack@n-api.service[61613]: X-User-Name: tempest-TaggedBootDevicesTest-2028021468-project-member Apr 13 23:03:11 user devstack@n-api.service[61613]: method: > Apr 13 23:03:11 user devstack@n-api.service[61613]: exception: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. Apr 13 23:03:11 user devstack@n-api.service[61613]: action_args: {'id': '1783d976-5b1b-466b-abb1-fd4b5c9c01aa'} Apr 13 23:03:11 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. Apr 13 23:03:11 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:03:11 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-26ee8e87-65db-40fc-a520-a46f1a53215f tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Returning 404 to user: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:03:11 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-26ee8e87-65db-40fc-a520-a46f1a53215f tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa" status: 404 len: 111 microversion: 2.32 time: 0.032516 Apr 13 23:03:11 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 177/524] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:03:11 2023] GET /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:03:11 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-92e5125c-cc3e-40cb-88e8-52f8effb17af tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Calling method '.version_select at 0x7f3d1df5bd90>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:03:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-92e5125c-cc3e-40cb-88e8-52f8effb17af tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1127154613" status: 204 len: 0 microversion: 2.32 time: 0.021247 Apr 13 23:03:11 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 173/525] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 13 23:03:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1127154613 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 23:03:11 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-7a39b182-b57f-4a8d-9aeb-57a6f70f1093 req-4158f2f8-ce87-41d4-992c-8f620bb00ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2979e2c-7ef9-4cbd-8daf-dedd5103f857", "name": "network-vif-plugged", "status": "completed", "tag": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536"}, {"server_uuid": "a2979e2c-7ef9-4cbd-8daf-dedd5103f857", "name": "network-vif-deleted", "tag": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7a39b182-b57f-4a8d-9aeb-57a6f70f1093 req-4158f2f8-ce87-41d4-992c-8f620bb00ace service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7a39b182-b57f-4a8d-9aeb-57a6f70f1093 req-4158f2f8-ce87-41d4-992c-8f620bb00ace service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7a39b182-b57f-4a8d-9aeb-57a6f70f1093 req-4158f2f8-ce87-41d4-992c-8f620bb00ace service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:11 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-7a39b182-b57f-4a8d-9aeb-57a6f70f1093 req-4158f2f8-ce87-41d4-992c-8f620bb00ace service nova] Creating event network-vif-plugged:5f5f289c-7a04-41f3-b5e8-73e45d3ac536 for instance a2979e2c-7ef9-4cbd-8daf-dedd5103f857 on user Apr 13 23:03:11 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-7a39b182-b57f-4a8d-9aeb-57a6f70f1093 req-4158f2f8-ce87-41d4-992c-8f620bb00ace service nova] Creating event network-vif-deleted:5f5f289c-7a04-41f3-b5e8-73e45d3ac536 for instance a2979e2c-7ef9-4cbd-8daf-dedd5103f857 on user Apr 13 23:03:11 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-7a39b182-b57f-4a8d-9aeb-57a6f70f1093 req-4158f2f8-ce87-41d4-992c-8f620bb00ace service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028272 Apr 13 23:03:11 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 176/526] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:03:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:03:12 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-090fbc8b-e116-4b02-9dad-38a8bbc69f2d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:12 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-090fbc8b-e116-4b02-9dad-38a8bbc69f2d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:03:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-090fbc8b-e116-4b02-9dad-38a8bbc69f2d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-090fbc8b-e116-4b02-9dad-38a8bbc69f2d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-090fbc8b-e116-4b02-9dad-38a8bbc69f2d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-090fbc8b-e116-4b02-9dad-38a8bbc69f2d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-090fbc8b-e116-4b02-9dad-38a8bbc69f2d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-090fbc8b-e116-4b02-9dad-38a8bbc69f2d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:12 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-090fbc8b-e116-4b02-9dad-38a8bbc69f2d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "POST /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8/action" status: 202 len: 0 microversion: 2.87 time: 0.086765 Apr 13 23:03:12 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 178/527] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 23:03:12 2023] POST /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:03:12 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-184bca64-3c6e-4e1d-8e6f-4281df18979e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:03:12 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-184bca64-3c6e-4e1d-8e6f-4281df18979e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:03:12 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-184bca64-3c6e-4e1d-8e6f-4281df18979e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:12 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-184bca64-3c6e-4e1d-8e6f-4281df18979e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:12 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-184bca64-3c6e-4e1d-8e6f-4281df18979e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:12 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-184bca64-3c6e-4e1d-8e6f-4281df18979e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:12 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-184bca64-3c6e-4e1d-8e6f-4281df18979e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:12 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-184bca64-3c6e-4e1d-8e6f-4281df18979e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:12 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-184bca64-3c6e-4e1d-8e6f-4281df18979e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:03:12 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-184bca64-3c6e-4e1d-8e6f-4281df18979e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:03:12 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-184bca64-3c6e-4e1d-8e6f-4281df18979e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:03:12 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-184bca64-3c6e-4e1d-8e6f-4281df18979e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8" status: 200 len: 1762 microversion: 2.87 time: 0.155791 Apr 13 23:03:12 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 174/528] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:03:12 2023] GET /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8 => generated 1762 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:03:13 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-0194edb1-7afe-483d-8568-7bd38ae9e391 req-1b08abe3-e032-4879-8c50-34c4022ff54c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ec73b0-9b2a-4fc1-be85-4179075afdb8", "name": "network-vif-unplugged", "status": "completed", "tag": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-0194edb1-7afe-483d-8568-7bd38ae9e391 req-1b08abe3-e032-4879-8c50-34c4022ff54c service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-0194edb1-7afe-483d-8568-7bd38ae9e391 req-1b08abe3-e032-4879-8c50-34c4022ff54c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-0194edb1-7afe-483d-8568-7bd38ae9e391 req-1b08abe3-e032-4879-8c50-34c4022ff54c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:13 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-0194edb1-7afe-483d-8568-7bd38ae9e391 req-1b08abe3-e032-4879-8c50-34c4022ff54c service nova] Creating event network-vif-unplugged:0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 on user Apr 13 23:03:13 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-0194edb1-7afe-483d-8568-7bd38ae9e391 req-1b08abe3-e032-4879-8c50-34c4022ff54c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030251 Apr 13 23:03:13 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 177/529] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:03:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:03:14 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-244006c5-4598-46ef-add8-c0791da07259 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:03:14 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-244006c5-4598-46ef-add8-c0791da07259 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:03:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-244006c5-4598-46ef-add8-c0791da07259 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-244006c5-4598-46ef-add8-c0791da07259 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-244006c5-4598-46ef-add8-c0791da07259 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-244006c5-4598-46ef-add8-c0791da07259 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-244006c5-4598-46ef-add8-c0791da07259 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-244006c5-4598-46ef-add8-c0791da07259 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:14 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-244006c5-4598-46ef-add8-c0791da07259 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] HTTP exception thrown: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. Apr 13 23:03:14 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-244006c5-4598-46ef-add8-c0791da07259 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Request method failure captured: Apr 13 23:03:14 user devstack@n-api.service[61613]: request: DELETE /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa HTTP/1.1 Apr 13 23:03:14 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:03:14 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:03:14 user devstack@n-api.service[61613]: Connection: close Apr 13 23:03:14 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:03:14 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:03:14 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:03:14 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:03:14 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:03:14 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIl0CV1I3Uof6WdrWw4mi_5bkV_2aEbU1qRi7gC_-t09TWwaBXkPRiq96vuQVtfuIRzuSTObPCCZd6nz5d3Dbv85Ki6lzsennodx_qxb8TsCwXmQIH_X6FxY_wDspiwqFpvlhH09DVO5L01vGWCRwVgey3M_wu27_sVrYiSW5uJpQzw Apr 13 23:03:14 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:03:14 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:03:14 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:03:14 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:03:14 user devstack@n-api.service[61613]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 23:03:14 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:03:14 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:03:14 user devstack@n-api.service[61613]: X-Project-Id: a3774169387c4fc59f3300af1a033087 Apr 13 23:03:14 user devstack@n-api.service[61613]: X-Project-Name: tempest-TaggedBootDevicesTest-2028021468 Apr 13 23:03:14 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:03:14 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:03:14 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a3774169387c4fc59f3300af1a033087"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a3774169387c4fc59f3300af1a033087"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a3774169387c4fc59f3300af1a033087"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:03:14 user devstack@n-api.service[61613]: X-Tenant: tempest-TaggedBootDevicesTest-2028021468 Apr 13 23:03:14 user devstack@n-api.service[61613]: X-Tenant-Id: a3774169387c4fc59f3300af1a033087 Apr 13 23:03:14 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2028021468 Apr 13 23:03:14 user devstack@n-api.service[61613]: X-User: tempest-TaggedBootDevicesTest-2028021468-project-member Apr 13 23:03:14 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:03:14 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:03:14 user devstack@n-api.service[61613]: X-User-Id: c16f28e6923c4fbfbb3c295377b6f9d8 Apr 13 23:03:14 user devstack@n-api.service[61613]: X-User-Name: tempest-TaggedBootDevicesTest-2028021468-project-member Apr 13 23:03:14 user devstack@n-api.service[61613]: method: > Apr 13 23:03:14 user devstack@n-api.service[61613]: exception: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. Apr 13 23:03:14 user devstack@n-api.service[61613]: action_args: {'id': '1783d976-5b1b-466b-abb1-fd4b5c9c01aa'} Apr 13 23:03:14 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. Apr 13 23:03:14 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:03:14 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-244006c5-4598-46ef-add8-c0791da07259 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Returning 404 to user: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:03:14 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-244006c5-4598-46ef-add8-c0791da07259 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa" status: 404 len: 111 microversion: 2.32 time: 0.028674 Apr 13 23:03:14 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 179/530] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 23:03:14 2023] DELETE /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:03:14 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c5960118-43f0-4ed5-844c-4fd1d17d6cd3 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:03:14 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-c5960118-43f0-4ed5-844c-4fd1d17d6cd3 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:03:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c5960118-43f0-4ed5-844c-4fd1d17d6cd3 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c5960118-43f0-4ed5-844c-4fd1d17d6cd3 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c5960118-43f0-4ed5-844c-4fd1d17d6cd3 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c5960118-43f0-4ed5-844c-4fd1d17d6cd3 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c5960118-43f0-4ed5-844c-4fd1d17d6cd3 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c5960118-43f0-4ed5-844c-4fd1d17d6cd3 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:14 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-c5960118-43f0-4ed5-844c-4fd1d17d6cd3 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] HTTP exception thrown: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. Apr 13 23:03:14 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c5960118-43f0-4ed5-844c-4fd1d17d6cd3 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Request method failure captured: Apr 13 23:03:14 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa HTTP/1.1 Apr 13 23:03:14 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:03:14 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:03:14 user devstack@n-api.service[61611]: Connection: close Apr 13 23:03:14 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:03:14 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:03:14 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:03:14 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:03:14 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:03:14 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIl0CV1I3Uof6WdrWw4mi_5bkV_2aEbU1qRi7gC_-t09TWwaBXkPRiq96vuQVtfuIRzuSTObPCCZd6nz5d3Dbv85Ki6lzsennodx_qxb8TsCwXmQIH_X6FxY_wDspiwqFpvlhH09DVO5L01vGWCRwVgey3M_wu27_sVrYiSW5uJpQzw Apr 13 23:03:14 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:03:14 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:03:14 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:03:14 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:03:14 user devstack@n-api.service[61611]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 23:03:14 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:03:14 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:03:14 user devstack@n-api.service[61611]: X-Project-Id: a3774169387c4fc59f3300af1a033087 Apr 13 23:03:14 user devstack@n-api.service[61611]: X-Project-Name: tempest-TaggedBootDevicesTest-2028021468 Apr 13 23:03:14 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:03:14 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:03:14 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a3774169387c4fc59f3300af1a033087"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a3774169387c4fc59f3300af1a033087"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a3774169387c4fc59f3300af1a033087"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:03:14 user devstack@n-api.service[61611]: X-Tenant: tempest-TaggedBootDevicesTest-2028021468 Apr 13 23:03:14 user devstack@n-api.service[61611]: X-Tenant-Id: a3774169387c4fc59f3300af1a033087 Apr 13 23:03:14 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2028021468 Apr 13 23:03:14 user devstack@n-api.service[61611]: X-User: tempest-TaggedBootDevicesTest-2028021468-project-member Apr 13 23:03:14 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:03:14 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:03:14 user devstack@n-api.service[61611]: X-User-Id: c16f28e6923c4fbfbb3c295377b6f9d8 Apr 13 23:03:14 user devstack@n-api.service[61611]: X-User-Name: tempest-TaggedBootDevicesTest-2028021468-project-member Apr 13 23:03:14 user devstack@n-api.service[61611]: method: > Apr 13 23:03:14 user devstack@n-api.service[61611]: exception: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. Apr 13 23:03:14 user devstack@n-api.service[61611]: action_args: {'id': '1783d976-5b1b-466b-abb1-fd4b5c9c01aa'} Apr 13 23:03:14 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. Apr 13 23:03:14 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:03:14 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c5960118-43f0-4ed5-844c-4fd1d17d6cd3 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Returning 404 to user: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:03:14 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-c5960118-43f0-4ed5-844c-4fd1d17d6cd3 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa" status: 404 len: 111 microversion: 2.32 time: 0.030345 Apr 13 23:03:14 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 175/531] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:03:14 2023] GET /compute/v2.1/servers/1783d976-5b1b-466b-abb1-fd4b5c9c01aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:03:15 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-f8a69062-19a6-497a-9e91-38c5c0451091 req-ada119d1-d517-48f4-a017-7de62b5f4dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ec73b0-9b2a-4fc1-be85-4179075afdb8", "name": "network-vif-plugged", "status": "completed", "tag": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37"}, {"server_uuid": "31ec73b0-9b2a-4fc1-be85-4179075afdb8", "name": "network-vif-plugged", "status": "completed", "tag": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f8a69062-19a6-497a-9e91-38c5c0451091 req-ada119d1-d517-48f4-a017-7de62b5f4dfa service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f8a69062-19a6-497a-9e91-38c5c0451091 req-ada119d1-d517-48f4-a017-7de62b5f4dfa service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f8a69062-19a6-497a-9e91-38c5c0451091 req-ada119d1-d517-48f4-a017-7de62b5f4dfa service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:15 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f8a69062-19a6-497a-9e91-38c5c0451091 req-ada119d1-d517-48f4-a017-7de62b5f4dfa service nova] Creating event network-vif-plugged:0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 on user Apr 13 23:03:15 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f8a69062-19a6-497a-9e91-38c5c0451091 req-ada119d1-d517-48f4-a017-7de62b5f4dfa service nova] Creating event network-vif-plugged:0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 on user Apr 13 23:03:15 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-f8a69062-19a6-497a-9e91-38c5c0451091 req-ada119d1-d517-48f4-a017-7de62b5f4dfa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032538 Apr 13 23:03:15 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 178/532] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:03:15 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:03:15 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-359cc27e-f13f-4add-99eb-cd90135163ae tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:03:15 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-359cc27e-f13f-4add-99eb-cd90135163ae tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:03:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-359cc27e-f13f-4add-99eb-cd90135163ae tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-359cc27e-f13f-4add-99eb-cd90135163ae tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-359cc27e-f13f-4add-99eb-cd90135163ae tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-359cc27e-f13f-4add-99eb-cd90135163ae tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-359cc27e-f13f-4add-99eb-cd90135163ae tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-359cc27e-f13f-4add-99eb-cd90135163ae tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:15 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-359cc27e-f13f-4add-99eb-cd90135163ae tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] HTTP exception thrown: Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b could not be found. Apr 13 23:03:15 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-359cc27e-f13f-4add-99eb-cd90135163ae tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Request method failure captured: Apr 13 23:03:15 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b HTTP/1.1 Apr 13 23:03:15 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:03:15 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:03:15 user devstack@n-api.service[61613]: Connection: close Apr 13 23:03:15 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:03:15 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:03:15 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:03:15 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:03:15 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:03:15 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIfA8POs3fwPWdIWuED5bQRvy1sRPQ7bek3Y8_6hntA1E2vMW5JP4EbYd4WjeiKPkGYkQ0RbnlRV9PxsF2lw8jd7Bn8V3L0LhE5pzNTNHBFB9Xpzt7CoX84mD0x6WZrafVyEKTW01ClUMbS-tyN6oH8x8-VczX4_MbGFJ52_-5q5EIo Apr 13 23:03:15 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:03:15 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:03:15 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:03:15 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:03:15 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:03:15 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:03:15 user devstack@n-api.service[61613]: X-Project-Id: d0648ea953174a8cae6085ac24d92bb1 Apr 13 23:03:15 user devstack@n-api.service[61613]: X-Project-Name: tempest-AttachVolumeTestJSON-118072319 Apr 13 23:03:15 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:03:15 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:03:15 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d0648ea953174a8cae6085ac24d92bb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d0648ea953174a8cae6085ac24d92bb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d0648ea953174a8cae6085ac24d92bb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:03:15 user devstack@n-api.service[61613]: X-Tenant: tempest-AttachVolumeTestJSON-118072319 Apr 13 23:03:15 user devstack@n-api.service[61613]: X-Tenant-Id: d0648ea953174a8cae6085ac24d92bb1 Apr 13 23:03:15 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-AttachVolumeTestJSON-118072319 Apr 13 23:03:15 user devstack@n-api.service[61613]: X-User: tempest-AttachVolumeTestJSON-118072319-project-member Apr 13 23:03:15 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:03:15 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:03:15 user devstack@n-api.service[61613]: X-User-Id: 13b46af525dd45678b69207e93683ac4 Apr 13 23:03:15 user devstack@n-api.service[61613]: X-User-Name: tempest-AttachVolumeTestJSON-118072319-project-member Apr 13 23:03:15 user devstack@n-api.service[61613]: method: > Apr 13 23:03:15 user devstack@n-api.service[61613]: exception: Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b could not be found. Apr 13 23:03:15 user devstack@n-api.service[61613]: action_args: {'id': '92e1fa88-8896-4198-af4d-56d44baf3b9b'} Apr 13 23:03:15 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b could not be found. Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b could not be found. Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b could not be found. Apr 13 23:03:15 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:03:15 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-359cc27e-f13f-4add-99eb-cd90135163ae tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Returning 404 to user: Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:03:15 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-359cc27e-f13f-4add-99eb-cd90135163ae tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b" status: 404 len: 111 microversion: 2.1 time: 0.030190 Apr 13 23:03:15 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 180/533] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:03:15 2023] GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:03:15 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-a80a9be6-d4c5-4db5-87d6-f4a536752c78 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '.version_select at 0x7f3d1c3ff130>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:03:15 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-a80a9be6-d4c5-4db5-87d6-f4a536752c78 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-361428277" status: 202 len: 0 microversion: 2.1 time: 0.030597 Apr 13 23:03:15 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 176/534] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 23:03:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-361428277 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:03:16 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-9a6e33c3-46f3-476f-aa46-d7fa43b341ad tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Action: 'create', calling method: .version_select at 0x7f3d1dc949d0>, body: {"keypair": {"name": "tempest-keypair-229071683", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfUWVI8IOPtgGPQLd2ogb+LB+C/kCsbiJob8LDBPVAPjT7tXncvXjQQwIlebgqjND7LJaONDLwpT9nVZvik8n9ZW1Lw+oRM7rk6w4HCK0B0/C97upBdLDNGJcWvMc8+RA=="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:16 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-9a6e33c3-46f3-476f-aa46-d7fa43b341ad tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Getting quotas for project d0648ea953174a8cae6085ac24d92bb1. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:03:16 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-9a6e33c3-46f3-476f-aa46-d7fa43b341ad tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Getting quotas for user 13b46af525dd45678b69207e93683ac4 and project d0648ea953174a8cae6085ac24d92bb1. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:03:16 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-9a6e33c3-46f3-476f-aa46-d7fa43b341ad tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055216 Apr 13 23:03:16 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 179/535] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 23:03:16 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:03:17 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-0a6a15dd-3e38-4a77-8e8d-5153ee3c104c req-a11f034b-cbea-45ab-8724-3f00fdcade49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ec73b0-9b2a-4fc1-be85-4179075afdb8", "name": "network-vif-plugged", "status": "completed", "tag": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0a6a15dd-3e38-4a77-8e8d-5153ee3c104c req-a11f034b-cbea-45ab-8724-3f00fdcade49 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0a6a15dd-3e38-4a77-8e8d-5153ee3c104c req-a11f034b-cbea-45ab-8724-3f00fdcade49 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0a6a15dd-3e38-4a77-8e8d-5153ee3c104c req-a11f034b-cbea-45ab-8724-3f00fdcade49 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:17 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-0a6a15dd-3e38-4a77-8e8d-5153ee3c104c req-a11f034b-cbea-45ab-8724-3f00fdcade49 service nova] Creating event network-vif-plugged:0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 on user Apr 13 23:03:17 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-0a6a15dd-3e38-4a77-8e8d-5153ee3c104c req-a11f034b-cbea-45ab-8724-3f00fdcade49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033585 Apr 13 23:03:17 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 181/536] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:03:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:03:18 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1360471313", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8"}], "security_groups": [{"name": "tempest-securitygroup--1420375851"}], "key_name": "tempest-keypair-229071683", "user_data": "}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:18 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] validate_networks() for [('a708f18b-3eef-4221-bc1b-e4c90b6c6af8', None, None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:03:18 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:03:18 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:03:18 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:03:18 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:03:18 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:03:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:18 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Getting quotas for project d0648ea953174a8cae6085ac24d92bb1. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:03:18 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Getting quotas for user 13b46af525dd45678b69207e93683ac4 and project d0648ea953174a8cae6085ac24d92bb1. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:03:18 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:03:18 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:03:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.568720 Apr 13 23:03:19 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 177/537] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:03:18 2023] POST /compute/v2.1/servers => generated 400 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:03:19 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-9e2240e9-3fe9-4afe-8364-6355ed04255c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:03:19 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-9e2240e9-3fe9-4afe-8364-6355ed04255c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:03:19 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-9e2240e9-3fe9-4afe-8364-6355ed04255c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b46af525dd45678b69207e93683ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0648ea953174a8cae6085ac24d92bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:03:19 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-9e2240e9-3fe9-4afe-8364-6355ed04255c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa" status: 200 len: 1231 microversion: 2.1 time: 0.064422 Apr 13 23:03:19 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 180/538] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:03:19 2023] GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa => generated 1231 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:03:19 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-3a8f020f-51d1-4502-af55-1d77ccfa00ef tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:03:19 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-3a8f020f-51d1-4502-af55-1d77ccfa00ef tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:03:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3a8f020f-51d1-4502-af55-1d77ccfa00ef tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3a8f020f-51d1-4502-af55-1d77ccfa00ef tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3a8f020f-51d1-4502-af55-1d77ccfa00ef tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3a8f020f-51d1-4502-af55-1d77ccfa00ef tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3a8f020f-51d1-4502-af55-1d77ccfa00ef tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3a8f020f-51d1-4502-af55-1d77ccfa00ef tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:19 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-3a8f020f-51d1-4502-af55-1d77ccfa00ef tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] HTTP exception thrown: Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 could not be found. Apr 13 23:03:19 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-3a8f020f-51d1-4502-af55-1d77ccfa00ef tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Request method failure captured: Apr 13 23:03:19 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91 HTTP/1.1 Apr 13 23:03:19 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:03:19 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:03:19 user devstack@n-api.service[61613]: Connection: close Apr 13 23:03:19 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:03:19 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:03:19 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:03:19 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:03:19 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:03:19 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIfFTd-GGuNLZhpg908qNRAUWwxNgAfeCUimfaNa0b2DAb_GHBW4t-lVsJou0tz2or0f6bqUrzjLpozKP8y8w6AYyySvjwkcbo4hPrDnlFVSF3sjpEAKCireroRzn4mK7Mj_j8ZmmwDUGWxo3vQ2pAQyz117nhwbP810jFnZYlkUbLs Apr 13 23:03:19 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:03:19 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:03:19 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:03:19 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:03:19 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:03:19 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:03:19 user devstack@n-api.service[61613]: X-Project-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:03:19 user devstack@n-api.service[61613]: X-Project-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:03:19 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:03:19 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:03:19 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:03:19 user devstack@n-api.service[61613]: X-Tenant: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:03:19 user devstack@n-api.service[61613]: X-Tenant-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:03:19 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:03:19 user devstack@n-api.service[61613]: X-User: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:03:19 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:03:19 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:03:19 user devstack@n-api.service[61613]: X-User-Id: 98594f3f6ccf4ffdbfd91bcf192d936e Apr 13 23:03:19 user devstack@n-api.service[61613]: X-User-Name: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:03:19 user devstack@n-api.service[61613]: method: > Apr 13 23:03:19 user devstack@n-api.service[61613]: exception: Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 could not be found. Apr 13 23:03:19 user devstack@n-api.service[61613]: action_args: {'id': '4435b0c4-7292-4348-bcd9-a712a2df3e91'} Apr 13 23:03:19 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 could not be found. Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 could not be found. Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 could not be found. Apr 13 23:03:19 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:03:19 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-3a8f020f-51d1-4502-af55-1d77ccfa00ef tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Returning 404 to user: Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:03:19 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-3a8f020f-51d1-4502-af55-1d77ccfa00ef tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91" status: 404 len: 111 microversion: 2.1 time: 0.033525 Apr 13 23:03:19 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 182/539] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:03:19 2023] GET /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:03:19 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-771397d6-ac71-4654-801a-72c3c2b0b5ae tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '.version_select at 0x7f3d1c505990>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:03:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-771397d6-ac71-4654-801a-72c3c2b0b5ae tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-286597101" status: 202 len: 0 microversion: 2.1 time: 0.021248 Apr 13 23:03:19 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 178/540] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 23:03:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-286597101 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:03:20 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-67267d87-28e9-4d9e-9bae-77f014686ff1 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Action: 'create', calling method: .version_select at 0x7f3d1dc491b0>, body: {"keypair": {"name": "tempest-keypair-661625581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnOM9oAIvYAaqonstAu0i79x5C14LxizYJ582GKlS7wdPZc54wVauzPY4OtlQHFLxduXboFLe6QmDOJ72hstQUoK/NDE7whGNJS43ASabOJL/ItpHphysZg+R09NEMAOQ=="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:20 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-67267d87-28e9-4d9e-9bae-77f014686ff1 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting quotas for project 85ccac99656842aca44f9f1eb7aa167a. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:03:20 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-67267d87-28e9-4d9e-9bae-77f014686ff1 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting quotas for user 98594f3f6ccf4ffdbfd91bcf192d936e and project 85ccac99656842aca44f9f1eb7aa167a. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:03:20 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-67267d87-28e9-4d9e-9bae-77f014686ff1 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047684 Apr 13 23:03:20 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 181/541] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 23:03:20 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:03:20 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-7359674b-570b-4048-a385-3af2318a2502 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:03:20 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-7359674b-570b-4048-a385-3af2318a2502 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:03:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7359674b-570b-4048-a385-3af2318a2502 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7359674b-570b-4048-a385-3af2318a2502 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7359674b-570b-4048-a385-3af2318a2502 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7359674b-570b-4048-a385-3af2318a2502 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7359674b-570b-4048-a385-3af2318a2502 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7359674b-570b-4048-a385-3af2318a2502 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:20 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-7359674b-570b-4048-a385-3af2318a2502 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.211450 Apr 13 23:03:20 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 183/542] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 23:03:20 2023] GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195/os-interface => generated 282 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:03:21 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-15856e0b-81ce-489e-ab02-207e48238d94 req-04f8c151-12ee-477c-96c8-39eb8a058fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "381385a1-4c41-4479-b5cc-0222c9a7c2aa", "tag": "b8721edc-dc82-4768-a1ae-894b8561f8a8"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-15856e0b-81ce-489e-ab02-207e48238d94 req-04f8c151-12ee-477c-96c8-39eb8a058fc4 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-15856e0b-81ce-489e-ab02-207e48238d94 req-04f8c151-12ee-477c-96c8-39eb8a058fc4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-15856e0b-81ce-489e-ab02-207e48238d94 req-04f8c151-12ee-477c-96c8-39eb8a058fc4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:21 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-15856e0b-81ce-489e-ab02-207e48238d94 req-04f8c151-12ee-477c-96c8-39eb8a058fc4 service nova] Creating event network-changed:b8721edc-dc82-4768-a1ae-894b8561f8a8 for instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa on user Apr 13 23:03:21 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-15856e0b-81ce-489e-ab02-207e48238d94 req-04f8c151-12ee-477c-96c8-39eb8a058fc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030905 Apr 13 23:03:21 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 179/543] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:03:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:03:21 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-947473118", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf"}], "security_groups": [{"name": "tempest-securitygroup--252823417"}], "key_name": "tempest-keypair-661625581", "user_data": "}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:21 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] validate_networks() for [('d59145a7-f00c-4cd3-ab12-f4b6ae2608cf', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:03:22 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-2906974b-c22c-4376-833e-10b9e28a5b1f req-235fa9ce-1f6f-4943-b88d-33c5e50e44f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2906974b-c22c-4376-833e-10b9e28a5b1f req-235fa9ce-1f6f-4943-b88d-33c5e50e44f2 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2906974b-c22c-4376-833e-10b9e28a5b1f req-235fa9ce-1f6f-4943-b88d-33c5e50e44f2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2906974b-c22c-4376-833e-10b9e28a5b1f req-235fa9ce-1f6f-4943-b88d-33c5e50e44f2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:22 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "642f82bc-0cb0-4600-b66e-9d8ab2b0a083"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:22 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:03:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-2906974b-c22c-4376-833e-10b9e28a5b1f req-235fa9ce-1f6f-4943-b88d-33c5e50e44f2 service nova] Creating event network-changed:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:03:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-2906974b-c22c-4376-833e-10b9e28a5b1f req-235fa9ce-1f6f-4943-b88d-33c5e50e44f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102714 Apr 13 23:03:22 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 184/544] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:03:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:03:22 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "POST /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.399749 Apr 13 23:03:22 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 180/545] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 23:03:22 2023] POST /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195/os-volume_attachments => generated 194 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:03:22 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:03:22 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:03:22 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:03:22 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:03:22 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:03:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:22 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting quotas for project 85ccac99656842aca44f9f1eb7aa167a. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:03:22 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting quotas for user 98594f3f6ccf4ffdbfd91bcf192d936e and project 85ccac99656842aca44f9f1eb7aa167a. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:03:22 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:03:22 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:03:22 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.092753 Apr 13 23:03:22 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 182/546] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:03:21 2023] POST /compute/v2.1/servers => generated 399 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:03:22 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8dfcf64f-8f99-4c25-b740-2fa7c5c4a6e2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:03:22 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-8dfcf64f-8f99-4c25-b740-2fa7c5c4a6e2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:03:23 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-8dfcf64f-8f99-4c25-b740-2fa7c5c4a6e2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98594f3f6ccf4ffdbfd91bcf192d936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ccac99656842aca44f9f1eb7aa167a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:03:23 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-8dfcf64f-8f99-4c25-b740-2fa7c5c4a6e2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889" status: 200 len: 1234 microversion: 2.1 time: 0.096200 Apr 13 23:03:23 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 185/547] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:03:22 2023] GET /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889 => generated 1234 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:03:23 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-dffc550f-9e2f-4311-9ad9-a92acfa663ac req-564a11e8-f021-49d9-a80a-8d78a7e66f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "381385a1-4c41-4479-b5cc-0222c9a7c2aa", "name": "network-vif-plugged", "status": "completed", "tag": "b8721edc-dc82-4768-a1ae-894b8561f8a8"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-dffc550f-9e2f-4311-9ad9-a92acfa663ac req-564a11e8-f021-49d9-a80a-8d78a7e66f43 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-dffc550f-9e2f-4311-9ad9-a92acfa663ac req-564a11e8-f021-49d9-a80a-8d78a7e66f43 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-dffc550f-9e2f-4311-9ad9-a92acfa663ac req-564a11e8-f021-49d9-a80a-8d78a7e66f43 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:24 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-dffc550f-9e2f-4311-9ad9-a92acfa663ac req-564a11e8-f021-49d9-a80a-8d78a7e66f43 service nova] Creating event network-vif-plugged:b8721edc-dc82-4768-a1ae-894b8561f8a8 for instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa on user Apr 13 23:03:24 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-dffc550f-9e2f-4311-9ad9-a92acfa663ac req-564a11e8-f021-49d9-a80a-8d78a7e66f43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078616 Apr 13 23:03:24 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 181/548] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:03:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:03:26 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-369dd1f4-e4e3-4415-aa48-f8d2d0c52ea5 req-39658f44-f96b-4555-8fc4-4e9047fd2d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "381385a1-4c41-4479-b5cc-0222c9a7c2aa", "name": "network-vif-plugged", "status": "completed", "tag": "b8721edc-dc82-4768-a1ae-894b8561f8a8"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-369dd1f4-e4e3-4415-aa48-f8d2d0c52ea5 req-39658f44-f96b-4555-8fc4-4e9047fd2d76 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-369dd1f4-e4e3-4415-aa48-f8d2d0c52ea5 req-39658f44-f96b-4555-8fc4-4e9047fd2d76 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-369dd1f4-e4e3-4415-aa48-f8d2d0c52ea5 req-39658f44-f96b-4555-8fc4-4e9047fd2d76 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:26 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-369dd1f4-e4e3-4415-aa48-f8d2d0c52ea5 req-39658f44-f96b-4555-8fc4-4e9047fd2d76 service nova] Creating event network-vif-plugged:b8721edc-dc82-4768-a1ae-894b8561f8a8 for instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa on user Apr 13 23:03:26 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-369dd1f4-e4e3-4415-aa48-f8d2d0c52ea5 req-39658f44-f96b-4555-8fc4-4e9047fd2d76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036811 Apr 13 23:03:26 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 183/549] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:03:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:03:26 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-99514a43-16ae-446a-99f3-0c252c10605a req-eca4b74f-cb7c-4100-9492-52576cd1b065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454fafc9-4b6f-40c3-80fa-d590fb946889", "tag": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-99514a43-16ae-446a-99f3-0c252c10605a req-eca4b74f-cb7c-4100-9492-52576cd1b065 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-99514a43-16ae-446a-99f3-0c252c10605a req-eca4b74f-cb7c-4100-9492-52576cd1b065 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-99514a43-16ae-446a-99f3-0c252c10605a req-eca4b74f-cb7c-4100-9492-52576cd1b065 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:26 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-99514a43-16ae-446a-99f3-0c252c10605a req-eca4b74f-cb7c-4100-9492-52576cd1b065 service nova] Creating event network-changed:4eef61bd-3529-4ab4-9f58-881fac9cc1d6 for instance 454fafc9-4b6f-40c3-80fa-d590fb946889 on user Apr 13 23:03:26 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-99514a43-16ae-446a-99f3-0c252c10605a req-eca4b74f-cb7c-4100-9492-52576cd1b065 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043674 Apr 13 23:03:26 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 186/550] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:03:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:03:29 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:03:29 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:03:29 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d0389e56-b9b6-4832-a918-a1ab3e41139d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:03:29 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-d0389e56-b9b6-4832-a918-a1ab3e41139d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:03:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0389e56-b9b6-4832-a918-a1ab3e41139d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0389e56-b9b6-4832-a918-a1ab3e41139d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0389e56-b9b6-4832-a918-a1ab3e41139d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0389e56-b9b6-4832-a918-a1ab3e41139d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0389e56-b9b6-4832-a918-a1ab3e41139d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0389e56-b9b6-4832-a918-a1ab3e41139d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:29 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-d0389e56-b9b6-4832-a918-a1ab3e41139d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:03:29 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-d0389e56-b9b6-4832-a918-a1ab3e41139d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06ecf305-65ca-4752-984c-cb7094593493" status: 200 len: 1441 microversion: 2.1 time: 0.402031 Apr 13 23:03:29 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 182/551] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:03:29 2023] GET /compute/v2.1/servers/06ecf305-65ca-4752-984c-cb7094593493 => generated 1441 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:03:29 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-f22ce8b4-9bd0-4614-8745-3b5e13fdced5 req-5e1dd6c4-2ba2-44fb-bf54-b9648da92ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454fafc9-4b6f-40c3-80fa-d590fb946889", "name": "network-vif-plugged", "status": "completed", "tag": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f22ce8b4-9bd0-4614-8745-3b5e13fdced5 req-5e1dd6c4-2ba2-44fb-bf54-b9648da92ff2 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f22ce8b4-9bd0-4614-8745-3b5e13fdced5 req-5e1dd6c4-2ba2-44fb-bf54-b9648da92ff2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f22ce8b4-9bd0-4614-8745-3b5e13fdced5 req-5e1dd6c4-2ba2-44fb-bf54-b9648da92ff2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:29 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f22ce8b4-9bd0-4614-8745-3b5e13fdced5 req-5e1dd6c4-2ba2-44fb-bf54-b9648da92ff2 service nova] Creating event network-vif-plugged:4eef61bd-3529-4ab4-9f58-881fac9cc1d6 for instance 454fafc9-4b6f-40c3-80fa-d590fb946889 on user Apr 13 23:03:29 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-f22ce8b4-9bd0-4614-8745-3b5e13fdced5 req-5e1dd6c4-2ba2-44fb-bf54-b9648da92ff2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035150 Apr 13 23:03:29 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 184/552] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:03:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:03:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:31 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:03:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:31 user devstack@n-api.service[61613]: DEBUG nova.objects.instance [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'flavor' on Instance uuid deb24b5e-f858-4068-88c5-3c7708c7e195 {{(pid=61613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:03:31 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "POST /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195/action" status: 200 len: 32 microversion: 2.1 time: 0.258204 Apr 13 23:03:31 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 187/553] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 23:03:31 2023] POST /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195/action => generated 32 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 23:03:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-13bdc2cb-2f9e-49d3-aee0-75f010cc5aee tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:03:31 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-13bdc2cb-2f9e-49d3-aee0-75f010cc5aee tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:03:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-13bdc2cb-2f9e-49d3-aee0-75f010cc5aee tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-13bdc2cb-2f9e-49d3-aee0-75f010cc5aee tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-13bdc2cb-2f9e-49d3-aee0-75f010cc5aee tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-13bdc2cb-2f9e-49d3-aee0-75f010cc5aee tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-13bdc2cb-2f9e-49d3-aee0-75f010cc5aee tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-13bdc2cb-2f9e-49d3-aee0-75f010cc5aee tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-b2f566c0-3326-446d-aa1a-a4eee4403f6e req-2246d4f9-5b20-4168-824f-bd640349ba77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454fafc9-4b6f-40c3-80fa-d590fb946889", "name": "network-vif-plugged", "status": "completed", "tag": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b2f566c0-3326-446d-aa1a-a4eee4403f6e req-2246d4f9-5b20-4168-824f-bd640349ba77 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b2f566c0-3326-446d-aa1a-a4eee4403f6e req-2246d4f9-5b20-4168-824f-bd640349ba77 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b2f566c0-3326-446d-aa1a-a4eee4403f6e req-2246d4f9-5b20-4168-824f-bd640349ba77 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:31 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-b2f566c0-3326-446d-aa1a-a4eee4403f6e req-2246d4f9-5b20-4168-824f-bd640349ba77 service nova] Creating event network-vif-plugged:4eef61bd-3529-4ab4-9f58-881fac9cc1d6 for instance 454fafc9-4b6f-40c3-80fa-d590fb946889 on user Apr 13 23:03:31 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-b2f566c0-3326-446d-aa1a-a4eee4403f6e req-2246d4f9-5b20-4168-824f-bd640349ba77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053195 Apr 13 23:03:31 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 185/554] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:03:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:03:31 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-13bdc2cb-2f9e-49d3-aee0-75f010cc5aee tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:03:31 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-13bdc2cb-2f9e-49d3-aee0-75f010cc5aee tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195" status: 200 len: 1724 microversion: 2.1 time: 0.366697 Apr 13 23:03:31 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 183/555] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:03:31 2023] GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195 => generated 1724 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:03:33 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:03:33 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-03b2380e-e04a-47ba-b78a-401c01da7e66 req-7613f896-e8cb-408e-8802-3251c0fcec1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "name": "network-vif-unplugged", "status": "completed", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-03b2380e-e04a-47ba-b78a-401c01da7e66 req-7613f896-e8cb-408e-8802-3251c0fcec1f service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-03b2380e-e04a-47ba-b78a-401c01da7e66 req-7613f896-e8cb-408e-8802-3251c0fcec1f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-03b2380e-e04a-47ba-b78a-401c01da7e66 req-7613f896-e8cb-408e-8802-3251c0fcec1f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:33 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-03b2380e-e04a-47ba-b78a-401c01da7e66 req-7613f896-e8cb-408e-8802-3251c0fcec1f service nova] Creating event network-vif-unplugged:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:03:33 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-03b2380e-e04a-47ba-b78a-401c01da7e66 req-7613f896-e8cb-408e-8802-3251c0fcec1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065455 Apr 13 23:03:33 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 188/556] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:03:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:03:34 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:03:34 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=16 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:03:34 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-0591eef9-4480-4d7e-abc5-fcee2bd27307 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:03:34 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-0591eef9-4480-4d7e-abc5-fcee2bd27307 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:03:34 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=5 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:03:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0591eef9-4480-4d7e-abc5-fcee2bd27307 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0591eef9-4480-4d7e-abc5-fcee2bd27307 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0591eef9-4480-4d7e-abc5-fcee2bd27307 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0591eef9-4480-4d7e-abc5-fcee2bd27307 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0591eef9-4480-4d7e-abc5-fcee2bd27307 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0591eef9-4480-4d7e-abc5-fcee2bd27307 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:35 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=23 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:03:35 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-0591eef9-4480-4d7e-abc5-fcee2bd27307 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:03:35 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-0591eef9-4480-4d7e-abc5-fcee2bd27307 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2" status: 200 len: 1536 microversion: 2.1 time: 0.184846 Apr 13 23:03:35 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 186/557] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:03:34 2023] GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2 => generated 1536 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:03:35 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "name": "network-vif-plugged", "status": "completed", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}, {"server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "name": "network-vif-plugged", "status": "completed", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}, {"server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "name": "network-vif-plugged", "status": "completed", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}, {"server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "name": "network-vif-unplugged", "status": "completed", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}, {"server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "name": "network-vif-plugged", "status": "completed", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Creating event network-vif-plugged:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:03:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Creating event network-vif-plugged:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:03:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Creating event network-vif-plugged:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:03:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Creating event network-vif-unplugged:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:03:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Creating event network-vif-plugged:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:03:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.037219 Apr 13 23:03:35 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 184/558] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:03:35 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:03:37 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-c49bcc14-68d9-478c-b75d-955b8ff1a866 req-50d71352-111f-4e46-b417-516060499c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "name": "network-vif-plugged", "status": "completed", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}, {"server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "name": "network-vif-plugged", "status": "completed", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:03:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c49bcc14-68d9-478c-b75d-955b8ff1a866 req-50d71352-111f-4e46-b417-516060499c80 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c49bcc14-68d9-478c-b75d-955b8ff1a866 req-50d71352-111f-4e46-b417-516060499c80 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c49bcc14-68d9-478c-b75d-955b8ff1a866 req-50d71352-111f-4e46-b417-516060499c80 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:37 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-c49bcc14-68d9-478c-b75d-955b8ff1a866 req-50d71352-111f-4e46-b417-516060499c80 service nova] Creating event network-vif-plugged:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:03:37 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-c49bcc14-68d9-478c-b75d-955b8ff1a866 req-50d71352-111f-4e46-b417-516060499c80 service nova] Creating event network-vif-plugged:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:03:37 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-c49bcc14-68d9-478c-b75d-955b8ff1a866 req-50d71352-111f-4e46-b417-516060499c80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039606 Apr 13 23:03:37 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 189/559] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:03:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:03:59 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-90334e88-189d-449c-81ac-37bcf33749ce tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:03:59 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-90334e88-189d-449c-81ac-37bcf33749ce tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:03:59 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:03:59 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=5 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:03:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-90334e88-189d-449c-81ac-37bcf33749ce tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-90334e88-189d-449c-81ac-37bcf33749ce tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-90334e88-189d-449c-81ac-37bcf33749ce tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-90334e88-189d-449c-81ac-37bcf33749ce tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:03:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-90334e88-189d-449c-81ac-37bcf33749ce tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:03:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-90334e88-189d-449c-81ac-37bcf33749ce tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:03:59 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-90334e88-189d-449c-81ac-37bcf33749ce tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] HTTP exception thrown: Instance a2979e2c-7ef9-4cbd-8daf-dedd5103f857 could not be found. Apr 13 23:03:59 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-90334e88-189d-449c-81ac-37bcf33749ce tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Request method failure captured: Apr 13 23:03:59 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/a2979e2c-7ef9-4cbd-8daf-dedd5103f857 HTTP/1.1 Apr 13 23:03:59 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:03:59 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:03:59 user devstack@n-api.service[61612]: Connection: close Apr 13 23:03:59 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:03:59 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:03:59 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:03:59 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:03:59 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:03:59 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIm7EhhRsnJqRD5Z1Uex5Tv1M3QUNyWGQ62dsVgcvcJxzenrj_YXPOZZBftnuiBPKgi8Er35RH01pA1AiidCrvUABZlAoibEZgPBKqEk3ytOn_0J9n04hMVDGpj2gozi67hHXnf1xXNn5mRILqKi1Dt0MDV_GVhJc3MwMLHrwxGhDBw Apr 13 23:03:59 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:03:59 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:03:59 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:03:59 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:03:59 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:03:59 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:03:59 user devstack@n-api.service[61612]: X-Project-Id: ea52ea14393449b3b0ce5a8ed973e435 Apr 13 23:03:59 user devstack@n-api.service[61612]: X-Project-Name: tempest-VolumesNegativeTest-704025732 Apr 13 23:03:59 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:03:59 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:03:59 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ea52ea14393449b3b0ce5a8ed973e435"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ea52ea14393449b3b0ce5a8ed973e435"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ea52ea14393449b3b0ce5a8ed973e435"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:03:59 user devstack@n-api.service[61612]: X-Tenant: tempest-VolumesNegativeTest-704025732 Apr 13 23:03:59 user devstack@n-api.service[61612]: X-Tenant-Id: ea52ea14393449b3b0ce5a8ed973e435 Apr 13 23:03:59 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-VolumesNegativeTest-704025732 Apr 13 23:03:59 user devstack@n-api.service[61612]: X-User: tempest-VolumesNegativeTest-704025732-project-member Apr 13 23:03:59 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:03:59 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:03:59 user devstack@n-api.service[61612]: X-User-Id: 6eea00459cc046129decc442a6996ee0 Apr 13 23:03:59 user devstack@n-api.service[61612]: X-User-Name: tempest-VolumesNegativeTest-704025732-project-member Apr 13 23:03:59 user devstack@n-api.service[61612]: method: > Apr 13 23:03:59 user devstack@n-api.service[61612]: exception: Instance a2979e2c-7ef9-4cbd-8daf-dedd5103f857 could not be found. Apr 13 23:03:59 user devstack@n-api.service[61612]: action_args: {'id': 'a2979e2c-7ef9-4cbd-8daf-dedd5103f857'} Apr 13 23:03:59 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2979e2c-7ef9-4cbd-8daf-dedd5103f857 could not be found. Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2979e2c-7ef9-4cbd-8daf-dedd5103f857 could not be found. Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2979e2c-7ef9-4cbd-8daf-dedd5103f857 could not be found. Apr 13 23:03:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:03:59 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-90334e88-189d-449c-81ac-37bcf33749ce tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Returning 404 to user: Instance a2979e2c-7ef9-4cbd-8daf-dedd5103f857 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:03:59 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-90334e88-189d-449c-81ac-37bcf33749ce tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2979e2c-7ef9-4cbd-8daf-dedd5103f857" status: 404 len: 111 microversion: 2.1 time: 0.035852 Apr 13 23:03:59 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 187/560] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:03:59 2023] GET /compute/v2.1/servers/a2979e2c-7ef9-4cbd-8daf-dedd5103f857 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:04:02 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:02 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:02 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-056bdd2d-531f-4508-9e40-b4f8ee571601 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Action: 'create', calling method: .version_select at 0x7f3d1c507370>, body: {"keypair": {"name": "tempest-keypair-810663675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw=="}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:02 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-056bdd2d-531f-4508-9e40-b4f8ee571601 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Getting quotas for project b822a2f291ff497aaaf66c26ed6afc79. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:04:02 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-056bdd2d-531f-4508-9e40-b4f8ee571601 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Getting quotas for user 6fc4aba6767a4af9899ac437ab183df8 and project b822a2f291ff497aaaf66c26ed6afc79. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:04:02 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-056bdd2d-531f-4508-9e40-b4f8ee571601 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.064440 Apr 13 23:04:02 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 185/561] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 23:04:02 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 23:04:02 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:02 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:02 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-942bd94d-7cb7-47b8-9c50-fac6eee33a82 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:04:02 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-942bd94d-7cb7-47b8-9c50-fac6eee33a82 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:04:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-942bd94d-7cb7-47b8-9c50-fac6eee33a82 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-942bd94d-7cb7-47b8-9c50-fac6eee33a82 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-942bd94d-7cb7-47b8-9c50-fac6eee33a82 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-942bd94d-7cb7-47b8-9c50-fac6eee33a82 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-942bd94d-7cb7-47b8-9c50-fac6eee33a82 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-942bd94d-7cb7-47b8-9c50-fac6eee33a82 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:02 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-942bd94d-7cb7-47b8-9c50-fac6eee33a82 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:02 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-942bd94d-7cb7-47b8-9c50-fac6eee33a82 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:02 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-942bd94d-7cb7-47b8-9c50-fac6eee33a82 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-942bd94d-7cb7-47b8-9c50-fac6eee33a82 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8" status: 200 len: 1768 microversion: 2.87 time: 0.169781 Apr 13 23:04:02 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 190/562] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:04:02 2023] GET /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8 => generated 1768 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:04:04 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1989795804", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "networks": [{"uuid": "767f78e8-a875-44f4-bb0d-64565b88a59d"}]}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:04 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] validate_networks() for [('767f78e8-a875-44f4-bb0d-64565b88a59d', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:04:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-747263411", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "d1c8df15-f9c6-4610-9aa6-ada35fdc3f59"}, {"port": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "tag": "port-1"}, {"port": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "tag": "port-2"}, {"uuid": "9e024860-32be-4c74-b371-c7a8b93537c9", "tag": "net-1"}, {"uuid": "9e024860-32be-4c74-b371-c7a8b93537c9"}, {"uuid": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ca331d15-300c-4c30-b73c-3ec9156d8097", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "bdbff832-3d46-47da-8cae-62aa661d6ed4", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1102705881"}], "key_name": "tempest-keypair-810663675", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:04 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] validate_networks() for [('d1c8df15-f9c6-4610-9aa6-ada35fdc3f59', None, None, None, None, None), (None, None, '77b2db4a-b1bb-4628-a21a-1e24199cf117', None, None, None), (None, None, 'ec62d21a-cab5-4c13-85df-0e7134cc11d3', None, None, None), ('9e024860-32be-4c74-b371-c7a8b93537c9', None, None, None, None, None), ('9e024860-32be-4c74-b371-c7a8b93537c9', None, None, None, None, None), ('7aa77531-64a5-4665-b872-2e1cdbf9d9a3', '10.2.2.100', None, None, None, None), ('7aa77531-64a5-4665-b872-2e1cdbf9d9a3', '10.2.2.200', None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:04:05 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:04:05 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:04:05 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:04:05 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:04:05 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:04:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:05 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Getting quotas for project d8a3c684b0414336b2ca770eb1f3ab17. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:04:05 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Getting quotas for user 71593deacbd74fea9fc2faf5a9b08877 and project d8a3c684b0414336b2ca770eb1f3ab17. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:04:05 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:04:05 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:04:05 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.951445 Apr 13 23:04:05 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 188/563] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:04:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:04:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-edcd46e8-c0af-4ef0-94f3-1d3341d9a83e tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:04:05 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-edcd46e8-c0af-4ef0-94f3-1d3341d9a83e tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:04:05 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-edcd46e8-c0af-4ef0-94f3-1d3341d9a83e tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71593deacbd74fea9fc2faf5a9b08877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a3c684b0414336b2ca770eb1f3ab17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:05 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-edcd46e8-c0af-4ef0-94f3-1d3341d9a83e tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47dce1cc-c872-41f3-81af-acfc6ccabe18" status: 200 len: 1211 microversion: 2.1 time: 0.075299 Apr 13 23:04:05 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 191/564] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:04:05 2023] GET /compute/v2.1/servers/47dce1cc-c872-41f3-81af-acfc6ccabe18 => generated 1211 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:04:06 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:04:06 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:04:06 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:04:06 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:04:06 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:04:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:06 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Getting quotas for project b822a2f291ff497aaaf66c26ed6afc79. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:04:06 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Getting quotas for user 6fc4aba6767a4af9899ac437ab183df8 and project b822a2f291ff497aaaf66c26ed6afc79. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:04:07 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:04:07 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ca331d15-300c-4c30-b73c-3ec9156d8097',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='bdbff832-3d46-47da-8cae-62aa661d6ed4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1',volume_size=None,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:04:07 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 2.884676 Apr 13 23:04:07 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 186/565] 10.0.0.210 () {66 vars in 1266 bytes} [Thu Apr 13 23:04:04 2023] POST /compute/v2.1/servers => generated 404 bytes in 2886 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 23:04:07 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-2f10633f-0e2b-4f2f-a34f-9109862788b9 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:04:07 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-2f10633f-0e2b-4f2f-a34f-9109862788b9 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:04:07 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-2f10633f-0e2b-4f2f-a34f-9109862788b9 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc4aba6767a4af9899ac437ab183df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822a2f291ff497aaaf66c26ed6afc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:07 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-2f10633f-0e2b-4f2f-a34f-9109862788b9 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fc4aba6767a4af9899ac437ab183df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822a2f291ff497aaaf66c26ed6afc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:07 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-2f10633f-0e2b-4f2f-a34f-9109862788b9 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fc4aba6767a4af9899ac437ab183df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822a2f291ff497aaaf66c26ed6afc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-2f10633f-0e2b-4f2f-a34f-9109862788b9 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875" status: 200 len: 1278 microversion: 2.42 time: 0.081157 Apr 13 23:04:07 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 189/566] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:04:07 2023] GET /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875 => generated 1278 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:04:08 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-36341375-7ead-46bf-aa9a-ab1d95784725 req-ee33c1ce-648d-49c0-8ab1-9527dd1fc7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47dce1cc-c872-41f3-81af-acfc6ccabe18", "tag": "6ab4b160-3952-4332-9443-7f743c5feb6c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-36341375-7ead-46bf-aa9a-ab1d95784725 req-ee33c1ce-648d-49c0-8ab1-9527dd1fc7b2 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-36341375-7ead-46bf-aa9a-ab1d95784725 req-ee33c1ce-648d-49c0-8ab1-9527dd1fc7b2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-36341375-7ead-46bf-aa9a-ab1d95784725 req-ee33c1ce-648d-49c0-8ab1-9527dd1fc7b2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:08 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-36341375-7ead-46bf-aa9a-ab1d95784725 req-ee33c1ce-648d-49c0-8ab1-9527dd1fc7b2 service nova] Creating event network-changed:6ab4b160-3952-4332-9443-7f743c5feb6c for instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 on user Apr 13 23:04:08 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-36341375-7ead-46bf-aa9a-ab1d95784725 req-ee33c1ce-648d-49c0-8ab1-9527dd1fc7b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038371 Apr 13 23:04:08 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 192/567] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:09 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-657c3025-c461-4993-84aa-8267bb383f75 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:04:09 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-657c3025-c461-4993-84aa-8267bb383f75 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:04:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-657c3025-c461-4993-84aa-8267bb383f75 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-657c3025-c461-4993-84aa-8267bb383f75 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-657c3025-c461-4993-84aa-8267bb383f75 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-657c3025-c461-4993-84aa-8267bb383f75 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-657c3025-c461-4993-84aa-8267bb383f75 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-657c3025-c461-4993-84aa-8267bb383f75 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:09 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-657c3025-c461-4993-84aa-8267bb383f75 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b46af525dd45678b69207e93683ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0648ea953174a8cae6085ac24d92bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:09 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-657c3025-c461-4993-84aa-8267bb383f75 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa" status: 200 len: 1537 microversion: 2.1 time: 0.443566 Apr 13 23:04:09 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 187/568] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:04:09 2023] GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa => generated 1537 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:04:10 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-1f1348d7-0aa0-413d-9ed1-07bce6b1748a req-f0b36f9b-006a-42c2-9978-3ffe63e001dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47dce1cc-c872-41f3-81af-acfc6ccabe18", "name": "network-vif-plugged", "status": "completed", "tag": "6ab4b160-3952-4332-9443-7f743c5feb6c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-1f1348d7-0aa0-413d-9ed1-07bce6b1748a req-f0b36f9b-006a-42c2-9978-3ffe63e001dd service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-1f1348d7-0aa0-413d-9ed1-07bce6b1748a req-f0b36f9b-006a-42c2-9978-3ffe63e001dd service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-1f1348d7-0aa0-413d-9ed1-07bce6b1748a req-f0b36f9b-006a-42c2-9978-3ffe63e001dd service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:10 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-1f1348d7-0aa0-413d-9ed1-07bce6b1748a req-f0b36f9b-006a-42c2-9978-3ffe63e001dd service nova] Creating event network-vif-plugged:6ab4b160-3952-4332-9443-7f743c5feb6c for instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 on user Apr 13 23:04:10 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-1f1348d7-0aa0-413d-9ed1-07bce6b1748a req-f0b36f9b-006a-42c2-9978-3ffe63e001dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042054 Apr 13 23:04:10 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 190/569] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:12 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-f8761f14-65c9-46fa-9e69-891043b50ab0 req-1bac3ed1-2d41-466a-881a-6f7ed009f071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47dce1cc-c872-41f3-81af-acfc6ccabe18", "name": "network-vif-plugged", "status": "completed", "tag": "6ab4b160-3952-4332-9443-7f743c5feb6c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-f8761f14-65c9-46fa-9e69-891043b50ab0 req-1bac3ed1-2d41-466a-881a-6f7ed009f071 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-f8761f14-65c9-46fa-9e69-891043b50ab0 req-1bac3ed1-2d41-466a-881a-6f7ed009f071 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-f8761f14-65c9-46fa-9e69-891043b50ab0 req-1bac3ed1-2d41-466a-881a-6f7ed009f071 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:12 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-f8761f14-65c9-46fa-9e69-891043b50ab0 req-1bac3ed1-2d41-466a-881a-6f7ed009f071 service nova] Creating event network-vif-plugged:6ab4b160-3952-4332-9443-7f743c5feb6c for instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 on user Apr 13 23:04:12 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-f8761f14-65c9-46fa-9e69-891043b50ab0 req-1bac3ed1-2d41-466a-881a-6f7ed009f071 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038306 Apr 13 23:04:12 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 193/570] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:13 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-472c361a-ef1a-4b19-842a-d67e6a09ac1f tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:04:13 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-472c361a-ef1a-4b19-842a-d67e6a09ac1f tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:04:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-472c361a-ef1a-4b19-842a-d67e6a09ac1f tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-472c361a-ef1a-4b19-842a-d67e6a09ac1f tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-472c361a-ef1a-4b19-842a-d67e6a09ac1f tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-472c361a-ef1a-4b19-842a-d67e6a09ac1f tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-472c361a-ef1a-4b19-842a-d67e6a09ac1f tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-472c361a-ef1a-4b19-842a-d67e6a09ac1f tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:13 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-472c361a-ef1a-4b19-842a-d67e6a09ac1f tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98594f3f6ccf4ffdbfd91bcf192d936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ccac99656842aca44f9f1eb7aa167a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:13 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-472c361a-ef1a-4b19-842a-d67e6a09ac1f tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889" status: 200 len: 1543 microversion: 2.1 time: 0.368556 Apr 13 23:04:13 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 188/571] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:04:13 2023] GET /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889 => generated 1543 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:04:14 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-722d92ba-5981-4835-9316-b1c770821b61 req-e7aa2feb-f7a3-4aac-866d-2e558e34d5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "tag": "03889253-8210-430d-b5a9-47d58c066803"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-722d92ba-5981-4835-9316-b1c770821b61 req-e7aa2feb-f7a3-4aac-866d-2e558e34d5e3 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-722d92ba-5981-4835-9316-b1c770821b61 req-e7aa2feb-f7a3-4aac-866d-2e558e34d5e3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-722d92ba-5981-4835-9316-b1c770821b61 req-e7aa2feb-f7a3-4aac-866d-2e558e34d5e3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:14 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-722d92ba-5981-4835-9316-b1c770821b61 req-e7aa2feb-f7a3-4aac-866d-2e558e34d5e3 service nova] Creating event network-changed:03889253-8210-430d-b5a9-47d58c066803 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:14 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-722d92ba-5981-4835-9316-b1c770821b61 req-e7aa2feb-f7a3-4aac-866d-2e558e34d5e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035277 Apr 13 23:04:14 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 191/572] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:16 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:16 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "tag": "77b2db4a-b1bb-4628-a21a-1e24199cf117"}, {"name": "network-changed", "server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "tag": "ec62d21a-cab5-4c13-85df-0e7134cc11d3"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] Creating event network-changed:77b2db4a-b1bb-4628-a21a-1e24199cf117 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] Creating event network-changed:ec62d21a-cab5-4c13-85df-0e7134cc11d3 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.090456 Apr 13 23:04:16 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 194/573] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:16 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:18 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "tag": "56cd2acf-5e6d-4703-a160-2cf983399d6b"}, {"name": "network-changed", "server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "tag": "d6a692ff-983e-4d9b-abb2-45fee280cb60"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:18 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:18 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=10 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] Creating event network-changed:56cd2acf-5e6d-4703-a160-2cf983399d6b for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] Creating event network-changed:d6a692ff-983e-4d9b-abb2-45fee280cb60 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047732 Apr 13 23:04:18 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 189/574] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:18 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:20 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:20 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=8 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:20 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-1e0a3c4f-c08a-460f-b84b-20bb004410e7 req-72e1604e-103a-4279-8d94-aa2ed0955d71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "tag": "ad651a01-eb81-4baf-8b6c-ff196a729d67"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-1e0a3c4f-c08a-460f-b84b-20bb004410e7 req-72e1604e-103a-4279-8d94-aa2ed0955d71 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-1e0a3c4f-c08a-460f-b84b-20bb004410e7 req-72e1604e-103a-4279-8d94-aa2ed0955d71 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-1e0a3c4f-c08a-460f-b84b-20bb004410e7 req-72e1604e-103a-4279-8d94-aa2ed0955d71 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:21 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-1e0a3c4f-c08a-460f-b84b-20bb004410e7 req-72e1604e-103a-4279-8d94-aa2ed0955d71 service nova] Creating event network-changed:ad651a01-eb81-4baf-8b6c-ff196a729d67 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:21 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-1e0a3c4f-c08a-460f-b84b-20bb004410e7 req-72e1604e-103a-4279-8d94-aa2ed0955d71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040023 Apr 13 23:04:21 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 192/575] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:22 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-05a29669-d197-4080-9c87-119b33234544 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:04:22 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-05a29669-d197-4080-9c87-119b33234544 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:04:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-05a29669-d197-4080-9c87-119b33234544 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-05a29669-d197-4080-9c87-119b33234544 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-05a29669-d197-4080-9c87-119b33234544 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-05a29669-d197-4080-9c87-119b33234544 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-05a29669-d197-4080-9c87-119b33234544 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-05a29669-d197-4080-9c87-119b33234544 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:22 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-05a29669-d197-4080-9c87-119b33234544 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-05a29669-d197-4080-9c87-119b33234544 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195" status: 200 len: 1704 microversion: 2.1 time: 0.303705 Apr 13 23:04:22 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 195/576] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:04:21 2023] GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195 => generated 1704 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 23:04:23 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-595eb28a-a23c-4a76-b1da-2fec8c3c5016 req-0c77b890-b06c-47a6-aa28-7c2c41b1ce02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "tag": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-595eb28a-a23c-4a76-b1da-2fec8c3c5016 req-0c77b890-b06c-47a6-aa28-7c2c41b1ce02 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-595eb28a-a23c-4a76-b1da-2fec8c3c5016 req-0c77b890-b06c-47a6-aa28-7c2c41b1ce02 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-595eb28a-a23c-4a76-b1da-2fec8c3c5016 req-0c77b890-b06c-47a6-aa28-7c2c41b1ce02 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:23 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-595eb28a-a23c-4a76-b1da-2fec8c3c5016 req-0c77b890-b06c-47a6-aa28-7c2c41b1ce02 service nova] Creating event network-changed:a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:23 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-595eb28a-a23c-4a76-b1da-2fec8c3c5016 req-0c77b890-b06c-47a6-aa28-7c2c41b1ce02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110319 Apr 13 23:04:23 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 190/577] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:29 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-5b9e8638-8d90-4278-95cf-781fac36cd71 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:04:29 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-5b9e8638-8d90-4278-95cf-781fac36cd71 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:04:29 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5b9e8638-8d90-4278-95cf-781fac36cd71 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5b9e8638-8d90-4278-95cf-781fac36cd71 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5b9e8638-8d90-4278-95cf-781fac36cd71 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5b9e8638-8d90-4278-95cf-781fac36cd71 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5b9e8638-8d90-4278-95cf-781fac36cd71 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5b9e8638-8d90-4278-95cf-781fac36cd71 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:29 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=11 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:30 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-5b9e8638-8d90-4278-95cf-781fac36cd71 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:30 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-5b9e8638-8d90-4278-95cf-781fac36cd71 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06ecf305-65ca-4752-984c-cb7094593493" status: 200 len: 1441 microversion: 2.1 time: 0.479864 Apr 13 23:04:30 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 193/578] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:04:29 2023] GET /compute/v2.1/servers/06ecf305-65ca-4752-984c-cb7094593493 => generated 1441 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:04:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-0b0c6462-d868-4996-809a-3e4a64f79f4c req-72b23c3c-eab5-4e74-a90d-b78d6abe0a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "03889253-8210-430d-b5a9-47d58c066803"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0b0c6462-d868-4996-809a-3e4a64f79f4c req-72b23c3c-eab5-4e74-a90d-b78d6abe0a88 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0b0c6462-d868-4996-809a-3e4a64f79f4c req-72b23c3c-eab5-4e74-a90d-b78d6abe0a88 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0b0c6462-d868-4996-809a-3e4a64f79f4c req-72b23c3c-eab5-4e74-a90d-b78d6abe0a88 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:31 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-0b0c6462-d868-4996-809a-3e4a64f79f4c req-72b23c3c-eab5-4e74-a90d-b78d6abe0a88 service nova] Creating event network-vif-plugged:03889253-8210-430d-b5a9-47d58c066803 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:31 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-0b0c6462-d868-4996-809a-3e4a64f79f4c req-72b23c3c-eab5-4e74-a90d-b78d6abe0a88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139292 Apr 13 23:04:31 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 196/579] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-d84f1489-d3bf-4074-8120-2c930130bd4d req-394dbe83-53bf-4d7d-9587-ea19829d2fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "77b2db4a-b1bb-4628-a21a-1e24199cf117"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d84f1489-d3bf-4074-8120-2c930130bd4d req-394dbe83-53bf-4d7d-9587-ea19829d2fd0 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d84f1489-d3bf-4074-8120-2c930130bd4d req-394dbe83-53bf-4d7d-9587-ea19829d2fd0 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d84f1489-d3bf-4074-8120-2c930130bd4d req-394dbe83-53bf-4d7d-9587-ea19829d2fd0 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:31 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-d84f1489-d3bf-4074-8120-2c930130bd4d req-394dbe83-53bf-4d7d-9587-ea19829d2fd0 service nova] Creating event network-vif-plugged:77b2db4a-b1bb-4628-a21a-1e24199cf117 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:31 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-d84f1489-d3bf-4074-8120-2c930130bd4d req-394dbe83-53bf-4d7d-9587-ea19829d2fd0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087265 Apr 13 23:04:31 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 191/580] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 23:04:32 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-f6b4108c-e57d-4d7f-ba7d-78248626caa4 req-e94956a6-eb09-483a-b144-206a3fac50f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "56cd2acf-5e6d-4703-a160-2cf983399d6b"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f6b4108c-e57d-4d7f-ba7d-78248626caa4 req-e94956a6-eb09-483a-b144-206a3fac50f3 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f6b4108c-e57d-4d7f-ba7d-78248626caa4 req-e94956a6-eb09-483a-b144-206a3fac50f3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f6b4108c-e57d-4d7f-ba7d-78248626caa4 req-e94956a6-eb09-483a-b144-206a3fac50f3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:32 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f6b4108c-e57d-4d7f-ba7d-78248626caa4 req-e94956a6-eb09-483a-b144-206a3fac50f3 service nova] Creating event network-vif-plugged:56cd2acf-5e6d-4703-a160-2cf983399d6b for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:32 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-f6b4108c-e57d-4d7f-ba7d-78248626caa4 req-e94956a6-eb09-483a-b144-206a3fac50f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059674 Apr 13 23:04:32 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 194/581] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:33 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "03889253-8210-430d-b5a9-47d58c066803"}, {"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "d6a692ff-983e-4d9b-abb2-45fee280cb60"}, {"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "d6a692ff-983e-4d9b-abb2-45fee280cb60"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:33 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=19 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:33 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=21 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:33 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] Creating event network-vif-plugged:03889253-8210-430d-b5a9-47d58c066803 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:33 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] Creating event network-vif-plugged:d6a692ff-983e-4d9b-abb2-45fee280cb60 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:33 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] Creating event network-vif-plugged:d6a692ff-983e-4d9b-abb2-45fee280cb60 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:33 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.056822 Apr 13 23:04:33 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 197/582] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:33 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:33 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "77b2db4a-b1bb-4628-a21a-1e24199cf117"}, {"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "ec62d21a-cab5-4c13-85df-0e7134cc11d3"}, {"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "ec62d21a-cab5-4c13-85df-0e7134cc11d3"}, {"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:33 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:33 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:04:33 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:04:33 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=21 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:33 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] Creating event network-vif-plugged:77b2db4a-b1bb-4628-a21a-1e24199cf117 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:33 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] Creating event network-vif-plugged:ec62d21a-cab5-4c13-85df-0e7134cc11d3 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:33 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] Creating event network-vif-plugged:ec62d21a-cab5-4c13-85df-0e7134cc11d3 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:33 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] Creating event network-vif-plugged:a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:33 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.054115 Apr 13 23:04:33 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 192/583] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:33 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:33 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Going to try to terminate instance {{(pid=61612) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:04:33 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/06ecf305-65ca-4752-984c-cb7094593493" status: 204 len: 0 microversion: 2.1 time: 0.175019 Apr 13 23:04:33 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 195/584] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:04:33 2023] DELETE /compute/v2.1/servers/06ecf305-65ca-4752-984c-cb7094593493 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:04:33 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-1a020fad-21ef-4b98-8392-bdeff6f5de76 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:04:33 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-1a020fad-21ef-4b98-8392-bdeff6f5de76 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:04:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a020fad-21ef-4b98-8392-bdeff6f5de76 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a020fad-21ef-4b98-8392-bdeff6f5de76 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a020fad-21ef-4b98-8392-bdeff6f5de76 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a020fad-21ef-4b98-8392-bdeff6f5de76 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a020fad-21ef-4b98-8392-bdeff6f5de76 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:33 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a020fad-21ef-4b98-8392-bdeff6f5de76 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:34 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-1a020fad-21ef-4b98-8392-bdeff6f5de76 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:34 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-1a020fad-21ef-4b98-8392-bdeff6f5de76 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06ecf305-65ca-4752-984c-cb7094593493" status: 200 len: 1447 microversion: 2.1 time: 0.190659 Apr 13 23:04:34 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 198/585] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:04:33 2023] GET /compute/v2.1/servers/06ecf305-65ca-4752-984c-cb7094593493 => generated 1447 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:04:34 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "56cd2acf-5e6d-4703-a160-2cf983399d6b"}, {"name": "network-changed", "server_uuid": "06ecf305-65ca-4752-984c-cb7094593493", "tag": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23"}, {"server_uuid": "06ecf305-65ca-4752-984c-cb7094593493", "name": "network-vif-unplugged", "status": "completed", "tag": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23"}, {"server_uuid": "06ecf305-65ca-4752-984c-cb7094593493", "name": "network-vif-plugged", "status": "completed", "tag": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:34 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] Creating event network-vif-plugged:56cd2acf-5e6d-4703-a160-2cf983399d6b for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:34 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] Creating event network-changed:e6bb2fdf-5afa-4160-b657-34c1bafa0b23 for instance 06ecf305-65ca-4752-984c-cb7094593493 on user Apr 13 23:04:34 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] Creating event network-vif-unplugged:e6bb2fdf-5afa-4160-b657-34c1bafa0b23 for instance 06ecf305-65ca-4752-984c-cb7094593493 on user Apr 13 23:04:34 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] Creating event network-vif-plugged:e6bb2fdf-5afa-4160-b657-34c1bafa0b23 for instance 06ecf305-65ca-4752-984c-cb7094593493 on user Apr 13 23:04:34 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 694 microversion: 2.1 time: 0.045206 Apr 13 23:04:34 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 193/586] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:34 2023] POST /compute/v2.1/os-server-external-events => generated 694 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:35 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-6c5885db-34bc-4b11-9ac1-c6cb67f21656 req-b372339c-1b5b-4a19-b91f-618a20d4727c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "ad651a01-eb81-4baf-8b6c-ff196a729d67"}, {"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "ad651a01-eb81-4baf-8b6c-ff196a729d67"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6c5885db-34bc-4b11-9ac1-c6cb67f21656 req-b372339c-1b5b-4a19-b91f-618a20d4727c service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6c5885db-34bc-4b11-9ac1-c6cb67f21656 req-b372339c-1b5b-4a19-b91f-618a20d4727c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6c5885db-34bc-4b11-9ac1-c6cb67f21656 req-b372339c-1b5b-4a19-b91f-618a20d4727c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:35 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-6c5885db-34bc-4b11-9ac1-c6cb67f21656 req-b372339c-1b5b-4a19-b91f-618a20d4727c service nova] Creating event network-vif-plugged:ad651a01-eb81-4baf-8b6c-ff196a729d67 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:35 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-6c5885db-34bc-4b11-9ac1-c6cb67f21656 req-b372339c-1b5b-4a19-b91f-618a20d4727c service nova] Creating event network-vif-plugged:ad651a01-eb81-4baf-8b6c-ff196a729d67 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:35 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e1889062-28ed-4a9f-b2e5-d7b37c0329ff tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:04:35 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-e1889062-28ed-4a9f-b2e5-d7b37c0329ff tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:04:35 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-6c5885db-34bc-4b11-9ac1-c6cb67f21656 req-b372339c-1b5b-4a19-b91f-618a20d4727c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034308 Apr 13 23:04:35 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 196/587] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e1889062-28ed-4a9f-b2e5-d7b37c0329ff tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e1889062-28ed-4a9f-b2e5-d7b37c0329ff tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e1889062-28ed-4a9f-b2e5-d7b37c0329ff tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e1889062-28ed-4a9f-b2e5-d7b37c0329ff tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e1889062-28ed-4a9f-b2e5-d7b37c0329ff tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e1889062-28ed-4a9f-b2e5-d7b37c0329ff tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:35 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-e1889062-28ed-4a9f-b2e5-d7b37c0329ff tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:35 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-e1889062-28ed-4a9f-b2e5-d7b37c0329ff tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2" status: 200 len: 1536 microversion: 2.1 time: 0.449397 Apr 13 23:04:35 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 199/588] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:04:35 2023] GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2 => generated 1536 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:04:35 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c86910c5-1de5-4f1d-8a87-77fd5fe2c68d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:04:35 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-c86910c5-1de5-4f1d-8a87-77fd5fe2c68d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:35 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-c86910c5-1de5-4f1d-8a87-77fd5fe2c68d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Searching by: {'deleted': False, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb'} {{(pid=61611) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 13 23:04:35 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-7df751d8-1929-46c0-8f14-371bb5a5fa37 req-938e7863-4136-4e65-b67b-7748afb05a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c86910c5-1de5-4f1d-8a87-77fd5fe2c68d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c86910c5-1de5-4f1d-8a87-77fd5fe2c68d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7df751d8-1929-46c0-8f14-371bb5a5fa37 req-938e7863-4136-4e65-b67b-7748afb05a48 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c86910c5-1de5-4f1d-8a87-77fd5fe2c68d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7df751d8-1929-46c0-8f14-371bb5a5fa37 req-938e7863-4136-4e65-b67b-7748afb05a48 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7df751d8-1929-46c0-8f14-371bb5a5fa37 req-938e7863-4136-4e65-b67b-7748afb05a48 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c86910c5-1de5-4f1d-8a87-77fd5fe2c68d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c86910c5-1de5-4f1d-8a87-77fd5fe2c68d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c86910c5-1de5-4f1d-8a87-77fd5fe2c68d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:35 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-7df751d8-1929-46c0-8f14-371bb5a5fa37 req-938e7863-4136-4e65-b67b-7748afb05a48 service nova] Creating event network-vif-plugged:a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:04:35 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-7df751d8-1929-46c0-8f14-371bb5a5fa37 req-938e7863-4136-4e65-b67b-7748afb05a48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033169 Apr 13 23:04:35 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 197/589] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:35 user devstack@n-api.service[61611]: DEBUG nova.compute.multi_cell_list [None req-c86910c5-1de5-4f1d-8a87-77fd5fe2c68d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 13 23:04:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-c86910c5-1de5-4f1d-8a87-77fd5fe2c68d tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.180418 Apr 13 23:04:35 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 194/590] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 13 23:04:35 2023] GET /compute/v2.1/servers => generated 340 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:35 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-1aca5df0-88e0-495f-af17-17204d216b89 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:04:35 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-1aca5df0-88e0-495f-af17-17204d216b89 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:04:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1aca5df0-88e0-495f-af17-17204d216b89 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1aca5df0-88e0-495f-af17-17204d216b89 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1aca5df0-88e0-495f-af17-17204d216b89 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1aca5df0-88e0-495f-af17-17204d216b89 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1aca5df0-88e0-495f-af17-17204d216b89 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1aca5df0-88e0-495f-af17-17204d216b89 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:36 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-1aca5df0-88e0-495f-af17-17204d216b89 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:36 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-1aca5df0-88e0-495f-af17-17204d216b89 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2" status: 200 len: 1536 microversion: 2.1 time: 0.162380 Apr 13 23:04:36 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 200/591] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:04:35 2023] GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2 => generated 1536 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:04:36 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-a23f5bbb-2bbe-480d-8c33-23e88cb2635b req-61d10d1e-6ab9-490c-81e8-94ae1e486d08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06ecf305-65ca-4752-984c-cb7094593493", "name": "network-vif-deleted", "tag": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:36 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a23f5bbb-2bbe-480d-8c33-23e88cb2635b req-61d10d1e-6ab9-490c-81e8-94ae1e486d08 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:36 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a23f5bbb-2bbe-480d-8c33-23e88cb2635b req-61d10d1e-6ab9-490c-81e8-94ae1e486d08 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:36 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a23f5bbb-2bbe-480d-8c33-23e88cb2635b req-61d10d1e-6ab9-490c-81e8-94ae1e486d08 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:36 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-a23f5bbb-2bbe-480d-8c33-23e88cb2635b req-61d10d1e-6ab9-490c-81e8-94ae1e486d08 service nova] Creating event network-vif-deleted:e6bb2fdf-5afa-4160-b657-34c1bafa0b23 for instance 06ecf305-65ca-4752-984c-cb7094593493 on user Apr 13 23:04:36 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-a23f5bbb-2bbe-480d-8c33-23e88cb2635b req-61d10d1e-6ab9-490c-81e8-94ae1e486d08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031812 Apr 13 23:04:36 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 198/592] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:38 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ac485a1-6354-4559-bc5d-5a22d6dfc7aa"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:38 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:04:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:38 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "POST /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314258 Apr 13 23:04:38 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 195/593] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 23:04:38 2023] POST /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:46 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-2fee8d4a-c2fe-4b74-aa42-4326ca372dd2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:04:46 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-2fee8d4a-c2fe-4b74-aa42-4326ca372dd2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:04:46 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=7 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:46 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=19 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:46 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2fee8d4a-c2fe-4b74-aa42-4326ca372dd2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:46 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2fee8d4a-c2fe-4b74-aa42-4326ca372dd2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:46 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2fee8d4a-c2fe-4b74-aa42-4326ca372dd2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:46 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2fee8d4a-c2fe-4b74-aa42-4326ca372dd2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:46 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2fee8d4a-c2fe-4b74-aa42-4326ca372dd2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:46 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2fee8d4a-c2fe-4b74-aa42-4326ca372dd2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:46 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-2fee8d4a-c2fe-4b74-aa42-4326ca372dd2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:46 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-2fee8d4a-c2fe-4b74-aa42-4326ca372dd2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2" status: 200 len: 1582 microversion: 2.1 time: 0.156774 Apr 13 23:04:46 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 201/594] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:04:46 2023] GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2 => generated 1582 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:04:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-89c371de-de53-4472-b3ec-5650cc660901 req-4d3889f3-84df-49f7-a37f-7fac818f7b38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c7e35a-9a30-44ff-bb5f-74d122bf08d2", "tag": "95b6eed4-ff6e-493e-a912-d263def87a82"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:48 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:48 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-89c371de-de53-4472-b3ec-5650cc660901 req-4d3889f3-84df-49f7-a37f-7fac818f7b38 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-89c371de-de53-4472-b3ec-5650cc660901 req-4d3889f3-84df-49f7-a37f-7fac818f7b38 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-89c371de-de53-4472-b3ec-5650cc660901 req-4d3889f3-84df-49f7-a37f-7fac818f7b38 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-89c371de-de53-4472-b3ec-5650cc660901 req-4d3889f3-84df-49f7-a37f-7fac818f7b38 service nova] Creating event network-changed:95b6eed4-ff6e-493e-a912-d263def87a82 for instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 on user Apr 13 23:04:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-89c371de-de53-4472-b3ec-5650cc660901 req-4d3889f3-84df-49f7-a37f-7fac818f7b38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039427 Apr 13 23:04:48 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 199/595] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:50 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:50 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=7 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:50 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:04:50 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-6b680e4e-ffe8-465f-8fba-282dec19c51e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-770098155"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:50 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-6b680e4e-ffe8-465f-8fba-282dec19c51e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:04:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6b680e4e-ffe8-465f-8fba-282dec19c51e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6b680e4e-ffe8-465f-8fba-282dec19c51e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6b680e4e-ffe8-465f-8fba-282dec19c51e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6b680e4e-ffe8-465f-8fba-282dec19c51e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6b680e4e-ffe8-465f-8fba-282dec19c51e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6b680e4e-ffe8-465f-8fba-282dec19c51e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:50 user devstack@n-api.service[61611]: INFO nova.network.security_group_api [None req-6b680e4e-ffe8-465f-8fba-282dec19c51e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Adding security group 7607aa26-ea36-4297-bbc5-1e76c8a104d1 to port 95b6eed4-ff6e-493e-a912-d263def87a82 Apr 13 23:04:50 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-6b680e4e-ffe8-465f-8fba-282dec19c51e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "POST /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/action" status: 202 len: 0 microversion: 2.1 time: 0.568711 Apr 13 23:04:50 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 196/596] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 23:04:50 2023] POST /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:04:50 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-4e2c22ab-9337-480a-a130-2112cb36688a req-dd837f82-2961-41b3-abf4-38dd98705e9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c7e35a-9a30-44ff-bb5f-74d122bf08d2", "tag": "95b6eed4-ff6e-493e-a912-d263def87a82"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:50 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-27ec712b-3c20-46f4-b355-fe74b7a48e09 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:04:50 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-27ec712b-3c20-46f4-b355-fe74b7a48e09 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:04:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-27ec712b-3c20-46f4-b355-fe74b7a48e09 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-27ec712b-3c20-46f4-b355-fe74b7a48e09 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-27ec712b-3c20-46f4-b355-fe74b7a48e09 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-27ec712b-3c20-46f4-b355-fe74b7a48e09 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-27ec712b-3c20-46f4-b355-fe74b7a48e09 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-27ec712b-3c20-46f4-b355-fe74b7a48e09 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:50 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4e2c22ab-9337-480a-a130-2112cb36688a req-dd837f82-2961-41b3-abf4-38dd98705e9b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:50 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4e2c22ab-9337-480a-a130-2112cb36688a req-dd837f82-2961-41b3-abf4-38dd98705e9b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:50 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4e2c22ab-9337-480a-a130-2112cb36688a req-dd837f82-2961-41b3-abf4-38dd98705e9b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:50 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-4e2c22ab-9337-480a-a130-2112cb36688a req-dd837f82-2961-41b3-abf4-38dd98705e9b service nova] Creating event network-changed:95b6eed4-ff6e-493e-a912-d263def87a82 for instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 on user Apr 13 23:04:50 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-4e2c22ab-9337-480a-a130-2112cb36688a req-dd837f82-2961-41b3-abf4-38dd98705e9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034539 Apr 13 23:04:50 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 202/597] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:51 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-27ec712b-3c20-46f4-b355-fe74b7a48e09 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:51 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-27ec712b-3c20-46f4-b355-fe74b7a48e09 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2" status: 200 len: 1747 microversion: 2.1 time: 0.547817 Apr 13 23:04:51 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 200/598] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:04:50 2023] GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2 => generated 1747 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:04:51 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:51 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:04:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:51 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "POST /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/action" status: 202 len: 0 microversion: 2.1 time: 0.176533 Apr 13 23:04:51 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 197/599] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 23:04:51 2023] POST /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:04:51 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-d4b62c43-173f-4cb5-b7a7-aaf7c7f74fdb tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:04:51 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-d4b62c43-173f-4cb5-b7a7-aaf7c7f74fdb tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:04:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d4b62c43-173f-4cb5-b7a7-aaf7c7f74fdb tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d4b62c43-173f-4cb5-b7a7-aaf7c7f74fdb tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d4b62c43-173f-4cb5-b7a7-aaf7c7f74fdb tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d4b62c43-173f-4cb5-b7a7-aaf7c7f74fdb tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d4b62c43-173f-4cb5-b7a7-aaf7c7f74fdb tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d4b62c43-173f-4cb5-b7a7-aaf7c7f74fdb tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:51 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-d4b62c43-173f-4cb5-b7a7-aaf7c7f74fdb tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:51 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-d4b62c43-173f-4cb5-b7a7-aaf7c7f74fdb tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2" status: 200 len: 1739 microversion: 2.1 time: 0.169716 Apr 13 23:04:51 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 203/600] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:04:51 2023] GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:04:54 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-c3558d70-82ad-4212-a431-26a0f848522f req-3857a6bd-b786-40b5-ab38-4e048e62010d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c7e35a-9a30-44ff-bb5f-74d122bf08d2", "name": "network-vif-unplugged", "status": "completed", "tag": "95b6eed4-ff6e-493e-a912-d263def87a82"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:54 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c3558d70-82ad-4212-a431-26a0f848522f req-3857a6bd-b786-40b5-ab38-4e048e62010d service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:54 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c3558d70-82ad-4212-a431-26a0f848522f req-3857a6bd-b786-40b5-ab38-4e048e62010d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:54 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c3558d70-82ad-4212-a431-26a0f848522f req-3857a6bd-b786-40b5-ab38-4e048e62010d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:54 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-c3558d70-82ad-4212-a431-26a0f848522f req-3857a6bd-b786-40b5-ab38-4e048e62010d service nova] Creating event network-vif-unplugged:95b6eed4-ff6e-493e-a912-d263def87a82 for instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 on user Apr 13 23:04:54 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-c3558d70-82ad-4212-a431-26a0f848522f req-3857a6bd-b786-40b5-ab38-4e048e62010d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033750 Apr 13 23:04:54 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 201/601] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:55 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-e2f5e35a-aa45-4b06-ae96-07ff01e1f3fa tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:04:55 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-e2f5e35a-aa45-4b06-ae96-07ff01e1f3fa tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:04:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e2f5e35a-aa45-4b06-ae96-07ff01e1f3fa tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e2f5e35a-aa45-4b06-ae96-07ff01e1f3fa tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e2f5e35a-aa45-4b06-ae96-07ff01e1f3fa tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e2f5e35a-aa45-4b06-ae96-07ff01e1f3fa tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e2f5e35a-aa45-4b06-ae96-07ff01e1f3fa tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e2f5e35a-aa45-4b06-ae96-07ff01e1f3fa tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:55 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-e2f5e35a-aa45-4b06-ae96-07ff01e1f3fa tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71593deacbd74fea9fc2faf5a9b08877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a3c684b0414336b2ca770eb1f3ab17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:55 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-e2f5e35a-aa45-4b06-ae96-07ff01e1f3fa tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47dce1cc-c872-41f3-81af-acfc6ccabe18" status: 200 len: 1494 microversion: 2.1 time: 0.146782 Apr 13 23:04:55 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 198/602] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:04:55 2023] GET /compute/v2.1/servers/47dce1cc-c872-41f3-81af-acfc6ccabe18 => generated 1494 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:04:56 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-8fc9c0cc-d0dc-41f0-a62a-9a843a3ddc73 req-f900eced-502c-481a-8460-b72356e4469f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c7e35a-9a30-44ff-bb5f-74d122bf08d2", "name": "network-vif-plugged", "status": "completed", "tag": "95b6eed4-ff6e-493e-a912-d263def87a82"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8fc9c0cc-d0dc-41f0-a62a-9a843a3ddc73 req-f900eced-502c-481a-8460-b72356e4469f service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8fc9c0cc-d0dc-41f0-a62a-9a843a3ddc73 req-f900eced-502c-481a-8460-b72356e4469f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8fc9c0cc-d0dc-41f0-a62a-9a843a3ddc73 req-f900eced-502c-481a-8460-b72356e4469f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:56 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-8fc9c0cc-d0dc-41f0-a62a-9a843a3ddc73 req-f900eced-502c-481a-8460-b72356e4469f service nova] Creating event network-vif-plugged:95b6eed4-ff6e-493e-a912-d263def87a82 for instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 on user Apr 13 23:04:56 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-8fc9c0cc-d0dc-41f0-a62a-9a843a3ddc73 req-f900eced-502c-481a-8460-b72356e4469f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033288 Apr 13 23:04:56 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 204/603] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:04:57 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-5c50d546-c539-4ab2-8c95-7ad5cc9842b5 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:04:57 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-5c50d546-c539-4ab2-8c95-7ad5cc9842b5 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:04:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5c50d546-c539-4ab2-8c95-7ad5cc9842b5 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5c50d546-c539-4ab2-8c95-7ad5cc9842b5 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5c50d546-c539-4ab2-8c95-7ad5cc9842b5 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5c50d546-c539-4ab2-8c95-7ad5cc9842b5 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5c50d546-c539-4ab2-8c95-7ad5cc9842b5 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5c50d546-c539-4ab2-8c95-7ad5cc9842b5 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:57 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-5c50d546-c539-4ab2-8c95-7ad5cc9842b5 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc4aba6767a4af9899ac437ab183df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822a2f291ff497aaaf66c26ed6afc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:57 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-5c50d546-c539-4ab2-8c95-7ad5cc9842b5 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fc4aba6767a4af9899ac437ab183df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822a2f291ff497aaaf66c26ed6afc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:57 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-5c50d546-c539-4ab2-8c95-7ad5cc9842b5 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fc4aba6767a4af9899ac437ab183df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822a2f291ff497aaaf66c26ed6afc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:04:57 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-5c50d546-c539-4ab2-8c95-7ad5cc9842b5 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875" status: 200 len: 2828 microversion: 2.42 time: 0.189579 Apr 13 23:04:57 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 202/604] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:04:57 2023] GET /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875 => generated 2828 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:04:58 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-b519b9bb-42a6-4dbe-b7d1-df5e454808c1 req-1fcfe0f6-ec79-4655-b8e7-f5c37d5a50d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c7e35a-9a30-44ff-bb5f-74d122bf08d2", "name": "network-vif-plugged", "status": "completed", "tag": "95b6eed4-ff6e-493e-a912-d263def87a82"}, {"server_uuid": "70c7e35a-9a30-44ff-bb5f-74d122bf08d2", "name": "network-vif-plugged", "status": "completed", "tag": "95b6eed4-ff6e-493e-a912-d263def87a82"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:04:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-b519b9bb-42a6-4dbe-b7d1-df5e454808c1 req-1fcfe0f6-ec79-4655-b8e7-f5c37d5a50d8 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:04:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-b519b9bb-42a6-4dbe-b7d1-df5e454808c1 req-1fcfe0f6-ec79-4655-b8e7-f5c37d5a50d8 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:04:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-b519b9bb-42a6-4dbe-b7d1-df5e454808c1 req-1fcfe0f6-ec79-4655-b8e7-f5c37d5a50d8 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:04:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-b519b9bb-42a6-4dbe-b7d1-df5e454808c1 req-1fcfe0f6-ec79-4655-b8e7-f5c37d5a50d8 service nova] Creating event network-vif-plugged:95b6eed4-ff6e-493e-a912-d263def87a82 for instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 on user Apr 13 23:04:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-b519b9bb-42a6-4dbe-b7d1-df5e454808c1 req-1fcfe0f6-ec79-4655-b8e7-f5c37d5a50d8 service nova] Creating event network-vif-plugged:95b6eed4-ff6e-493e-a912-d263def87a82 for instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 on user Apr 13 23:04:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-b519b9bb-42a6-4dbe-b7d1-df5e454808c1 req-1fcfe0f6-ec79-4655-b8e7-f5c37d5a50d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034705 Apr 13 23:04:58 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 199/605] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:04:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:02 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1404772141", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "networks": [{"uuid": "7ea834aa-c724-45fb-9c3f-497360beab67"}]}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:03 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] validate_networks() for [('7ea834aa-c724-45fb-9c3f-497360beab67', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:05:03 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:05:03 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:05:03 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:05:03 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:05:03 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:05:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:03 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Getting quotas for project 3fe77a2c491c4596ba7e6af3236d7de8. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:05:03 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Getting quotas for user 6db44e7cb89a46c2999916b0a266b159 and project 3fe77a2c491c4596ba7e6af3236d7de8. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:05:03 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:05:03 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:05:03 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.558931 Apr 13 23:05:03 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 205/606] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 23:05:02 2023] POST /compute/v2.1/servers => generated 378 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 23:05:03 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-fd69982a-3f4c-4148-8351-b3ff521f6fa8 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:03 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-fd69982a-3f4c-4148-8351-b3ff521f6fa8 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:03 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-fd69982a-3f4c-4148-8351-b3ff521f6fa8 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:05:03 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-fd69982a-3f4c-4148-8351-b3ff521f6fa8 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:05:03 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-fd69982a-3f4c-4148-8351-b3ff521f6fa8 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:05:03 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-fd69982a-3f4c-4148-8351-b3ff521f6fa8 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" status: 200 len: 1395 microversion: 2.87 time: 0.077977 Apr 13 23:05:03 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 203/607] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:05:03 2023] GET /compute/v2.1/servers/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 => generated 1395 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:05:06 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-e21a9a50-467d-4e43-86c3-e200d3f8623a req-6045d971-3221-42d7-8344-57a10e83c605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57", "tag": "d8177896-73ec-435e-8d3d-b468a1bf47a4"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-e21a9a50-467d-4e43-86c3-e200d3f8623a req-6045d971-3221-42d7-8344-57a10e83c605 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-e21a9a50-467d-4e43-86c3-e200d3f8623a req-6045d971-3221-42d7-8344-57a10e83c605 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-e21a9a50-467d-4e43-86c3-e200d3f8623a req-6045d971-3221-42d7-8344-57a10e83c605 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:06 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-e21a9a50-467d-4e43-86c3-e200d3f8623a req-6045d971-3221-42d7-8344-57a10e83c605 service nova] Creating event network-changed:d8177896-73ec-435e-8d3d-b468a1bf47a4 for instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 on user Apr 13 23:05:06 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-e21a9a50-467d-4e43-86c3-e200d3f8623a req-6045d971-3221-42d7-8344-57a10e83c605 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038160 Apr 13 23:05:06 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 200/608] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:05:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:08 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-294aee37-4524-418a-9fe1-8f1ae05e3908 req-54369586-0a58-4bbb-a9a3-66380606ee4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57", "name": "network-vif-plugged", "status": "completed", "tag": "d8177896-73ec-435e-8d3d-b468a1bf47a4"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-294aee37-4524-418a-9fe1-8f1ae05e3908 req-54369586-0a58-4bbb-a9a3-66380606ee4c service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-294aee37-4524-418a-9fe1-8f1ae05e3908 req-54369586-0a58-4bbb-a9a3-66380606ee4c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-294aee37-4524-418a-9fe1-8f1ae05e3908 req-54369586-0a58-4bbb-a9a3-66380606ee4c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:08 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-294aee37-4524-418a-9fe1-8f1ae05e3908 req-54369586-0a58-4bbb-a9a3-66380606ee4c service nova] Creating event network-vif-plugged:d8177896-73ec-435e-8d3d-b468a1bf47a4 for instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 on user Apr 13 23:05:08 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-294aee37-4524-418a-9fe1-8f1ae05e3908 req-54369586-0a58-4bbb-a9a3-66380606ee4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028829 Apr 13 23:05:08 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 206/609] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:05:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:09 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=16 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:05:09 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-5dce48e0-2e45-4fc4-b64b-4145953a18d2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:09 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-5dce48e0-2e45-4fc4-b64b-4145953a18d2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5dce48e0-2e45-4fc4-b64b-4145953a18d2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5dce48e0-2e45-4fc4-b64b-4145953a18d2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5dce48e0-2e45-4fc4-b64b-4145953a18d2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5dce48e0-2e45-4fc4-b64b-4145953a18d2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5dce48e0-2e45-4fc4-b64b-4145953a18d2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5dce48e0-2e45-4fc4-b64b-4145953a18d2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:09 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-5dce48e0-2e45-4fc4-b64b-4145953a18d2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.134533 Apr 13 23:05:09 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 204/610] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 23:05:09 2023] GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-interface => generated 283 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:10 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-3162b155-e0d8-41b3-9641-9dacb2f7d072 req-6e16cf48-8939-40f0-aabc-448128fbdbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57", "name": "network-vif-plugged", "status": "completed", "tag": "d8177896-73ec-435e-8d3d-b468a1bf47a4"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-3162b155-e0d8-41b3-9641-9dacb2f7d072 req-6e16cf48-8939-40f0-aabc-448128fbdbd7 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-3162b155-e0d8-41b3-9641-9dacb2f7d072 req-6e16cf48-8939-40f0-aabc-448128fbdbd7 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-3162b155-e0d8-41b3-9641-9dacb2f7d072 req-6e16cf48-8939-40f0-aabc-448128fbdbd7 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:10 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-3162b155-e0d8-41b3-9641-9dacb2f7d072 req-6e16cf48-8939-40f0-aabc-448128fbdbd7 service nova] Creating event network-vif-plugged:d8177896-73ec-435e-8d3d-b468a1bf47a4 for instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 on user Apr 13 23:05:10 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-3162b155-e0d8-41b3-9641-9dacb2f7d072 req-6e16cf48-8939-40f0-aabc-448128fbdbd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036754 Apr 13 23:05:10 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 201/611] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:05:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:10 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-01b3eea7-e896-41fc-b270-52cbc9fb1373 req-d50367de-3116-43f7-bcbb-b48f26df1c02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "381385a1-4c41-4479-b5cc-0222c9a7c2aa", "tag": "b8721edc-dc82-4768-a1ae-894b8561f8a8"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-01b3eea7-e896-41fc-b270-52cbc9fb1373 req-d50367de-3116-43f7-bcbb-b48f26df1c02 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-01b3eea7-e896-41fc-b270-52cbc9fb1373 req-d50367de-3116-43f7-bcbb-b48f26df1c02 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-01b3eea7-e896-41fc-b270-52cbc9fb1373 req-d50367de-3116-43f7-bcbb-b48f26df1c02 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:10 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-01b3eea7-e896-41fc-b270-52cbc9fb1373 req-d50367de-3116-43f7-bcbb-b48f26df1c02 service nova] Creating event network-changed:b8721edc-dc82-4768-a1ae-894b8561f8a8 for instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa on user Apr 13 23:05:10 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-01b3eea7-e896-41fc-b270-52cbc9fb1373 req-d50367de-3116-43f7-bcbb-b48f26df1c02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030244 Apr 13 23:05:10 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 207/612] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:05:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:10 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-1649da37-2f3e-4cc4-b6c2-e45585fb843e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:10 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-1649da37-2f3e-4cc4-b6c2-e45585fb843e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1649da37-2f3e-4cc4-b6c2-e45585fb843e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1649da37-2f3e-4cc4-b6c2-e45585fb843e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1649da37-2f3e-4cc4-b6c2-e45585fb843e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1649da37-2f3e-4cc4-b6c2-e45585fb843e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1649da37-2f3e-4cc4-b6c2-e45585fb843e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1649da37-2f3e-4cc4-b6c2-e45585fb843e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:10 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-1649da37-2f3e-4cc4-b6c2-e45585fb843e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/ips" status: 200 len: 104 microversion: 2.1 time: 0.038181 Apr 13 23:05:10 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 205/613] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 23:05:10 2023] GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/ips => generated 104 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:13 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b000e14-0fd0-44bf-ad10-feeb6aa2f187"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:13 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:13 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "POST /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266411 Apr 13 23:05:13 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 202/614] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 23:05:13 2023] POST /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:13 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:05:13 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:05:13 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-f755d3f6-1126-4cca-ab9d-c57f1cbdf54e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:13 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-f755d3f6-1126-4cca-ab9d-c57f1cbdf54e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f755d3f6-1126-4cca-ab9d-c57f1cbdf54e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f755d3f6-1126-4cca-ab9d-c57f1cbdf54e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f755d3f6-1126-4cca-ab9d-c57f1cbdf54e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f755d3f6-1126-4cca-ab9d-c57f1cbdf54e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f755d3f6-1126-4cca-ab9d-c57f1cbdf54e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f755d3f6-1126-4cca-ab9d-c57f1cbdf54e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:13 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-f755d3f6-1126-4cca-ab9d-c57f1cbdf54e tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.113129 Apr 13 23:05:13 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 208/615] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 23:05:13 2023] GET /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889/os-interface => generated 282 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:14 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-f9dfd7a9-c1d9-40fe-8c17-2b78834908f7 req-ece5a148-b575-4f52-a8ff-13c1976f0d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454fafc9-4b6f-40c3-80fa-d590fb946889", "tag": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:14 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:05:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f9dfd7a9-c1d9-40fe-8c17-2b78834908f7 req-ece5a148-b575-4f52-a8ff-13c1976f0d4a service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f9dfd7a9-c1d9-40fe-8c17-2b78834908f7 req-ece5a148-b575-4f52-a8ff-13c1976f0d4a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f9dfd7a9-c1d9-40fe-8c17-2b78834908f7 req-ece5a148-b575-4f52-a8ff-13c1976f0d4a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:14 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f9dfd7a9-c1d9-40fe-8c17-2b78834908f7 req-ece5a148-b575-4f52-a8ff-13c1976f0d4a service nova] Creating event network-changed:4eef61bd-3529-4ab4-9f58-881fac9cc1d6 for instance 454fafc9-4b6f-40c3-80fa-d590fb946889 on user Apr 13 23:05:14 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-f9dfd7a9-c1d9-40fe-8c17-2b78834908f7 req-ece5a148-b575-4f52-a8ff-13c1976f0d4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033895 Apr 13 23:05:14 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 206/616] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:05:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:14 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5464bdab-283e-4b6e-bc8d-9d90a0e03940 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:14 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-5464bdab-283e-4b6e-bc8d-9d90a0e03940 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5464bdab-283e-4b6e-bc8d-9d90a0e03940 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5464bdab-283e-4b6e-bc8d-9d90a0e03940 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5464bdab-283e-4b6e-bc8d-9d90a0e03940 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5464bdab-283e-4b6e-bc8d-9d90a0e03940 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5464bdab-283e-4b6e-bc8d-9d90a0e03940 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5464bdab-283e-4b6e-bc8d-9d90a0e03940 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:14 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-5464bdab-283e-4b6e-bc8d-9d90a0e03940 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889/ips" status: 200 len: 108 microversion: 2.1 time: 0.038373 Apr 13 23:05:14 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 203/617] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 23:05:14 2023] GET /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889/ips => generated 108 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:16 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a555bb1-72bd-44b8-8488-74f2095b1353"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:16 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:16 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:05:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:16 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=27 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:05:17 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "POST /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318894 Apr 13 23:05:17 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 209/618] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 23:05:16 2023] POST /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:21 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-3ccc501b-3548-4230-ba19-5c6269dbb55d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:21 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-3ccc501b-3548-4230-ba19-5c6269dbb55d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:21 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=21 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:05:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3ccc501b-3548-4230-ba19-5c6269dbb55d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3ccc501b-3548-4230-ba19-5c6269dbb55d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3ccc501b-3548-4230-ba19-5c6269dbb55d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3ccc501b-3548-4230-ba19-5c6269dbb55d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3ccc501b-3548-4230-ba19-5c6269dbb55d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3ccc501b-3548-4230-ba19-5c6269dbb55d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:21 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-3ccc501b-3548-4230-ba19-5c6269dbb55d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050494 Apr 13 23:05:21 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 207/619] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:05:21 2023] GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:21 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-534b79f5-4f57-4f83-b966-c01301320892 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:21 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-534b79f5-4f57-4f83-b966-c01301320892 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:21 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=17 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:05:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-534b79f5-4f57-4f83-b966-c01301320892 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-534b79f5-4f57-4f83-b966-c01301320892 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-534b79f5-4f57-4f83-b966-c01301320892 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-534b79f5-4f57-4f83-b966-c01301320892 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-534b79f5-4f57-4f83-b966-c01301320892 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-534b79f5-4f57-4f83-b966-c01301320892 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:21 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:05:21 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-534b79f5-4f57-4f83-b966-c01301320892 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments/6b000e14-0fd0-44bf-ad10-feeb6aa2f187" status: 200 len: 194 microversion: 2.1 time: 0.045101 Apr 13 23:05:21 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 204/620] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 23:05:21 2023] GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments/6b000e14-0fd0-44bf-ad10-feeb6aa2f187 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:22 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-22115419-3615-430c-a7b2-fc713a1a0bb6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:22 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-22115419-3615-430c-a7b2-fc713a1a0bb6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-22115419-3615-430c-a7b2-fc713a1a0bb6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-22115419-3615-430c-a7b2-fc713a1a0bb6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-22115419-3615-430c-a7b2-fc713a1a0bb6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-22115419-3615-430c-a7b2-fc713a1a0bb6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-22115419-3615-430c-a7b2-fc713a1a0bb6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-22115419-3615-430c-a7b2-fc713a1a0bb6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-22115419-3615-430c-a7b2-fc713a1a0bb6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] HTTP exception thrown: Cannot 'detach_volume' instance deb24b5e-f858-4068-88c5-3c7708c7e195 while it is in vm_state rescued Apr 13 23:05:22 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-22115419-3615-430c-a7b2-fc713a1a0bb6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Request method failure captured: Apr 13 23:05:22 user devstack@n-api.service[61613]: request: DELETE /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195/os-volume_attachments/642f82bc-0cb0-4600-b66e-9d8ab2b0a083 HTTP/1.1 Apr 13 23:05:22 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:05:22 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:05:22 user devstack@n-api.service[61613]: Connection: close Apr 13 23:05:22 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:05:22 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:05:22 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:05:22 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:05:22 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:05:22 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIfHQxdyZtX-iu-ThNLEChPZxANikiWLMMCIRZ25gQuq3VxddslsqUB5ikMLZ2ePv4vTU-JsJ6azIW7Ww-AQ-OdqvQt7Sws4Wi7PO44E5yqLWKj1QiMLUT5MdNcavqRLksBSt368wMT-Wgo0vOgAq25fxnYJ3kH5oYJcbmhrlbtbUaQ Apr 13 23:05:22 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:05:22 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:05:22 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:05:22 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:05:22 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:05:22 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:05:22 user devstack@n-api.service[61613]: X-Project-Id: 5b6a1fccc07f4f5a8f8f8617ae03955d Apr 13 23:05:22 user devstack@n-api.service[61613]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-258614246 Apr 13 23:05:22 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:05:22 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:05:22 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5b6a1fccc07f4f5a8f8f8617ae03955d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b6a1fccc07f4f5a8f8f8617ae03955d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b6a1fccc07f4f5a8f8f8617ae03955d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:05:22 user devstack@n-api.service[61613]: X-Tenant: tempest-ServerRescueNegativeTestJSON-258614246 Apr 13 23:05:22 user devstack@n-api.service[61613]: X-Tenant-Id: 5b6a1fccc07f4f5a8f8f8617ae03955d Apr 13 23:05:22 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-258614246 Apr 13 23:05:22 user devstack@n-api.service[61613]: X-User: tempest-ServerRescueNegativeTestJSON-258614246-project-member Apr 13 23:05:22 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:05:22 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:05:22 user devstack@n-api.service[61613]: X-User-Id: 28cb6d8d6e3d4ef7aa53bb17faf495c4 Apr 13 23:05:22 user devstack@n-api.service[61613]: X-User-Name: tempest-ServerRescueNegativeTestJSON-258614246-project-member Apr 13 23:05:22 user devstack@n-api.service[61613]: method: > Apr 13 23:05:22 user devstack@n-api.service[61613]: exception: Cannot 'detach_volume' instance deb24b5e-f858-4068-88c5-3c7708c7e195 while it is in vm_state rescued Apr 13 23:05:22 user devstack@n-api.service[61613]: action_args: {'server_id': 'deb24b5e-f858-4068-88c5-3c7708c7e195', 'id': '642f82bc-0cb0-4600-b66e-9d8ab2b0a083'} Apr 13 23:05:22 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance deb24b5e-f858-4068-88c5-3c7708c7e195 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance deb24b5e-f858-4068-88c5-3c7708c7e195 while it is in vm_state rescued Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance deb24b5e-f858-4068-88c5-3c7708c7e195 while it is in vm_state rescued Apr 13 23:05:22 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:05:22 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-22115419-3615-430c-a7b2-fc713a1a0bb6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Returning 409 to user: Cannot 'detach_volume' instance deb24b5e-f858-4068-88c5-3c7708c7e195 while it is in vm_state rescued {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:05:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-22115419-3615-430c-a7b2-fc713a1a0bb6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195/os-volume_attachments/642f82bc-0cb0-4600-b66e-9d8ab2b0a083" status: 409 len: 152 microversion: 2.1 time: 0.124951 Apr 13 23:05:22 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 210/621] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 23:05:22 2023] DELETE /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195/os-volume_attachments/642f82bc-0cb0-4600-b66e-9d8ab2b0a083 => generated 152 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 13 23:05:22 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-e1348219-e957-47a0-8f27-ca5f0f706b5c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:22 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-e1348219-e957-47a0-8f27-ca5f0f706b5c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e1348219-e957-47a0-8f27-ca5f0f706b5c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e1348219-e957-47a0-8f27-ca5f0f706b5c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e1348219-e957-47a0-8f27-ca5f0f706b5c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e1348219-e957-47a0-8f27-ca5f0f706b5c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e1348219-e957-47a0-8f27-ca5f0f706b5c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e1348219-e957-47a0-8f27-ca5f0f706b5c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:22 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-e1348219-e957-47a0-8f27-ca5f0f706b5c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "POST /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195/action" status: 202 len: 0 microversion: 2.1 time: 0.081714 Apr 13 23:05:22 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 208/622] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 23:05:22 2023] POST /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:05:22 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-7ba076fd-6c79-4ec9-9bb1-88d0c6c05028 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:22 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-7ba076fd-6c79-4ec9-9bb1-88d0c6c05028 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7ba076fd-6c79-4ec9-9bb1-88d0c6c05028 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7ba076fd-6c79-4ec9-9bb1-88d0c6c05028 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7ba076fd-6c79-4ec9-9bb1-88d0c6c05028 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7ba076fd-6c79-4ec9-9bb1-88d0c6c05028 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7ba076fd-6c79-4ec9-9bb1-88d0c6c05028 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7ba076fd-6c79-4ec9-9bb1-88d0c6c05028 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:22 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-7ba076fd-6c79-4ec9-9bb1-88d0c6c05028 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:05:22 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-7ba076fd-6c79-4ec9-9bb1-88d0c6c05028 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195" status: 200 len: 1712 microversion: 2.1 time: 0.172981 Apr 13 23:05:22 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 205/623] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:05:22 2023] GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195 => generated 1712 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:05:23 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-b1f123a9-7fe4-4933-b00b-8626bcfa061e req-ac0c50b4-a712-4bb8-82c4-e11118dc1885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "name": "network-vif-unplugged", "status": "completed", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-b1f123a9-7fe4-4933-b00b-8626bcfa061e req-ac0c50b4-a712-4bb8-82c4-e11118dc1885 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-b1f123a9-7fe4-4933-b00b-8626bcfa061e req-ac0c50b4-a712-4bb8-82c4-e11118dc1885 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-b1f123a9-7fe4-4933-b00b-8626bcfa061e req-ac0c50b4-a712-4bb8-82c4-e11118dc1885 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:23 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-b1f123a9-7fe4-4933-b00b-8626bcfa061e req-ac0c50b4-a712-4bb8-82c4-e11118dc1885 service nova] Creating event network-vif-unplugged:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:05:23 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-b1f123a9-7fe4-4933-b00b-8626bcfa061e req-ac0c50b4-a712-4bb8-82c4-e11118dc1885 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050411 Apr 13 23:05:23 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 211/624] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:05:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:23 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4613e4b-c3e6-4a25-bc39-1a81569e6916"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:23 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:23 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "POST /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305701 Apr 13 23:05:23 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 209/625] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 23:05:23 2023] POST /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:24 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-88930f0d-fa50-41e1-982f-04782fd89fc8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:24 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-88930f0d-fa50-41e1-982f-04782fd89fc8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-88930f0d-fa50-41e1-982f-04782fd89fc8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-88930f0d-fa50-41e1-982f-04782fd89fc8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-88930f0d-fa50-41e1-982f-04782fd89fc8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-88930f0d-fa50-41e1-982f-04782fd89fc8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-88930f0d-fa50-41e1-982f-04782fd89fc8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-88930f0d-fa50-41e1-982f-04782fd89fc8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:24 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-88930f0d-fa50-41e1-982f-04782fd89fc8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] HTTP exception thrown: Instance 06ecf305-65ca-4752-984c-cb7094593493 could not be found. Apr 13 23:05:24 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-88930f0d-fa50-41e1-982f-04782fd89fc8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Request method failure captured: Apr 13 23:05:24 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/06ecf305-65ca-4752-984c-cb7094593493 HTTP/1.1 Apr 13 23:05:24 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:05:24 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:05:24 user devstack@n-api.service[61611]: Connection: close Apr 13 23:05:24 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:05:24 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:05:24 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:05:24 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:05:24 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:05:24 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIgE6Gl7ZSFkA-_Uvg9_1wPLldz_ScwHJLtH7XfCRP3AC2MJmMpZ7l9bcSBPK09rKumFcFKFuRTWt2Sf1d4N5k3NQaJGxn8JzsH44PLD5fzCs7WE6phnuUwwFlbCj4pm_qJgudGzAbO1tRiQjdcyEvfY3Ke0cXzXFHfEZxyouzAaMTk Apr 13 23:05:24 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:05:24 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:05:24 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:05:24 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:05:24 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:05:24 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:05:24 user devstack@n-api.service[61611]: X-Project-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:05:24 user devstack@n-api.service[61611]: X-Project-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:05:24 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:05:24 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:05:24 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:05:24 user devstack@n-api.service[61611]: X-Tenant: tempest-TestVolumeBootPattern-751187467 Apr 13 23:05:24 user devstack@n-api.service[61611]: X-Tenant-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:05:24 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:05:24 user devstack@n-api.service[61611]: X-User: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:05:24 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:05:24 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:05:24 user devstack@n-api.service[61611]: X-User-Id: b289294050af4c41aeef8401832487a1 Apr 13 23:05:24 user devstack@n-api.service[61611]: X-User-Name: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:05:24 user devstack@n-api.service[61611]: method: > Apr 13 23:05:24 user devstack@n-api.service[61611]: exception: Instance 06ecf305-65ca-4752-984c-cb7094593493 could not be found. Apr 13 23:05:24 user devstack@n-api.service[61611]: action_args: {'id': '06ecf305-65ca-4752-984c-cb7094593493'} Apr 13 23:05:24 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06ecf305-65ca-4752-984c-cb7094593493 could not be found. Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06ecf305-65ca-4752-984c-cb7094593493 could not be found. Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06ecf305-65ca-4752-984c-cb7094593493 could not be found. Apr 13 23:05:24 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:05:24 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-88930f0d-fa50-41e1-982f-04782fd89fc8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Returning 404 to user: Instance 06ecf305-65ca-4752-984c-cb7094593493 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:05:24 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-88930f0d-fa50-41e1-982f-04782fd89fc8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06ecf305-65ca-4752-984c-cb7094593493" status: 404 len: 111 microversion: 2.1 time: 0.030559 Apr 13 23:05:24 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 206/626] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:05:24 2023] GET /compute/v2.1/servers/06ecf305-65ca-4752-984c-cb7094593493 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:05:24 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-876646587", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-408481084", "security_groups": [{"name": "tempest-secgroup-smoke-320997561"}], "block_device_mapping_v2": [{"uuid": "7e14d684-74a4-43e0-aa03-5dc4d626d990", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aadb940e-808f-4d62-87fe-765d072b7c2f"}]}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:24 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] validate_networks() for [('aadb940e-808f-4d62-87fe-765d072b7c2f', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:05:24 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:05:24 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:05:24 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:05:24 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:05:24 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:05:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:24 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting quotas for project d872848d5dc1471996e2f33bbbdebbd9. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:05:24 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting quotas for user b289294050af4c41aeef8401832487a1 and project d872848d5dc1471996e2f33bbbdebbd9. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:05:24 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:05:24 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7e14d684-74a4-43e0-aa03-5dc4d626d990',volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:05:25 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.795331 Apr 13 23:05:25 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 212/627] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:05:24 2023] POST /compute/v2.1/servers => generated 403 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:05:25 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:25 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:25 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-dc596564-6f87-4821-8c2c-22379cfd6b0d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:25 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-dc596564-6f87-4821-8c2c-22379cfd6b0d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:25 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-dc596564-6f87-4821-8c2c-22379cfd6b0d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:05:25 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-dc596564-6f87-4821-8c2c-22379cfd6b0d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a83b839-7b5b-4004-94da-d196d18caf0f" status: 200 len: 1088 microversion: 2.1 time: 0.117139 Apr 13 23:05:25 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 207/628] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:05:25 2023] GET /compute/v2.1/servers/1a83b839-7b5b-4004-94da-d196d18caf0f => generated 1088 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:05:25 user devstack@n-api.service[61612]: DEBUG nova.objects.instance [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'services' on Instance uuid 454fafc9-4b6f-40c3-80fa-d590fb946889 {{(pid=61612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:05:25 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889/os-volume_attachments/4a555bb1-72bd-44b8-8488-74f2095b1353" status: 202 len: 0 microversion: 2.1 time: 0.246178 Apr 13 23:05:25 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 210/629] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 23:05:25 2023] DELETE /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889/os-volume_attachments/4a555bb1-72bd-44b8-8488-74f2095b1353 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:05:25 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-9ac61879-f143-44d2-a79f-d235b332a653 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:25 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-9ac61879-f143-44d2-a79f-d235b332a653 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-9ac61879-f143-44d2-a79f-d235b332a653 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-9ac61879-f143-44d2-a79f-d235b332a653 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-9ac61879-f143-44d2-a79f-d235b332a653 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-9ac61879-f143-44d2-a79f-d235b332a653 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-9ac61879-f143-44d2-a79f-d235b332a653 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-9ac61879-f143-44d2-a79f-d235b332a653 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:25 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-9ac61879-f143-44d2-a79f-d235b332a653 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083991 Apr 13 23:05:25 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 213/630] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:05:25 2023] GET /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:25 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-d8aa50c5-73e4-42a4-95fa-e1c2c065a707 req-3b1dc3f9-a853-44c4-a1aa-a653423ad844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "name": "network-vif-plugged", "status": "completed", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d8aa50c5-73e4-42a4-95fa-e1c2c065a707 req-3b1dc3f9-a853-44c4-a1aa-a653423ad844 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d8aa50c5-73e4-42a4-95fa-e1c2c065a707 req-3b1dc3f9-a853-44c4-a1aa-a653423ad844 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d8aa50c5-73e4-42a4-95fa-e1c2c065a707 req-3b1dc3f9-a853-44c4-a1aa-a653423ad844 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:25 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-d8aa50c5-73e4-42a4-95fa-e1c2c065a707 req-3b1dc3f9-a853-44c4-a1aa-a653423ad844 service nova] Creating event network-vif-plugged:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:05:25 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-d8aa50c5-73e4-42a4-95fa-e1c2c065a707 req-3b1dc3f9-a853-44c4-a1aa-a653423ad844 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072870 Apr 13 23:05:25 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 208/631] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:05:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-532ac334-c2dd-43ea-98ed-5ce37cca40f1 req-19b0340d-5560-4dba-931d-6e442798bca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "name": "network-vif-plugged", "status": "completed", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}, {"server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "name": "network-vif-plugged", "status": "completed", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-532ac334-c2dd-43ea-98ed-5ce37cca40f1 req-19b0340d-5560-4dba-931d-6e442798bca3 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-532ac334-c2dd-43ea-98ed-5ce37cca40f1 req-19b0340d-5560-4dba-931d-6e442798bca3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-532ac334-c2dd-43ea-98ed-5ce37cca40f1 req-19b0340d-5560-4dba-931d-6e442798bca3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-532ac334-c2dd-43ea-98ed-5ce37cca40f1 req-19b0340d-5560-4dba-931d-6e442798bca3 service nova] Creating event network-vif-plugged:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:05:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-532ac334-c2dd-43ea-98ed-5ce37cca40f1 req-19b0340d-5560-4dba-931d-6e442798bca3 service nova] Creating event network-vif-plugged:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:05:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-532ac334-c2dd-43ea-98ed-5ce37cca40f1 req-19b0340d-5560-4dba-931d-6e442798bca3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048026 Apr 13 23:05:27 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 211/632] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:05:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:28 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-c8e3d884-6547-448b-a2cf-ddde1170825a req-582ba519-2f82-4edf-94de-2af386fa4dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a83b839-7b5b-4004-94da-d196d18caf0f", "tag": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c8e3d884-6547-448b-a2cf-ddde1170825a req-582ba519-2f82-4edf-94de-2af386fa4dc4 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c8e3d884-6547-448b-a2cf-ddde1170825a req-582ba519-2f82-4edf-94de-2af386fa4dc4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c8e3d884-6547-448b-a2cf-ddde1170825a req-582ba519-2f82-4edf-94de-2af386fa4dc4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:28 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-c8e3d884-6547-448b-a2cf-ddde1170825a req-582ba519-2f82-4edf-94de-2af386fa4dc4 service nova] Creating event network-changed:a88bc4ee-b024-4d26-9e56-e60daf6ef5fa for instance 1a83b839-7b5b-4004-94da-d196d18caf0f on user Apr 13 23:05:28 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-c8e3d884-6547-448b-a2cf-ddde1170825a req-582ba519-2f82-4edf-94de-2af386fa4dc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035194 Apr 13 23:05:28 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 214/633] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:05:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:32 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d26b45d9-4b30-4d4b-9ed9-939e50c04af6 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:32 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-d26b45d9-4b30-4d4b-9ed9-939e50c04af6 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d26b45d9-4b30-4d4b-9ed9-939e50c04af6 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d26b45d9-4b30-4d4b-9ed9-939e50c04af6 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d26b45d9-4b30-4d4b-9ed9-939e50c04af6 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d26b45d9-4b30-4d4b-9ed9-939e50c04af6 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d26b45d9-4b30-4d4b-9ed9-939e50c04af6 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d26b45d9-4b30-4d4b-9ed9-939e50c04af6 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:32 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-d26b45d9-4b30-4d4b-9ed9-939e50c04af6 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.090723 Apr 13 23:05:32 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 209/634] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:05:32 2023] GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments => generated 371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:32 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-1ca5298d-5fdf-4a92-a7f3-783215365e7e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:32 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-1ca5298d-5fdf-4a92-a7f3-783215365e7e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1ca5298d-5fdf-4a92-a7f3-783215365e7e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1ca5298d-5fdf-4a92-a7f3-783215365e7e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1ca5298d-5fdf-4a92-a7f3-783215365e7e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1ca5298d-5fdf-4a92-a7f3-783215365e7e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1ca5298d-5fdf-4a92-a7f3-783215365e7e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1ca5298d-5fdf-4a92-a7f3-783215365e7e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:32 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-1ca5298d-5fdf-4a92-a7f3-783215365e7e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments/6b000e14-0fd0-44bf-ad10-feeb6aa2f187" status: 200 len: 194 microversion: 2.1 time: 0.097206 Apr 13 23:05:32 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 212/635] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 23:05:32 2023] GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments/6b000e14-0fd0-44bf-ad10-feeb6aa2f187 => generated 194 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:32 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:32 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:32 user devstack@n-api.service[61613]: DEBUG nova.objects.instance [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'services' on Instance uuid 381385a1-4c41-4479-b5cc-0222c9a7c2aa {{(pid=61613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:05:32 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments/6b000e14-0fd0-44bf-ad10-feeb6aa2f187" status: 202 len: 0 microversion: 2.1 time: 0.275689 Apr 13 23:05:32 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 215/636] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 23:05:32 2023] DELETE /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments/6b000e14-0fd0-44bf-ad10-feeb6aa2f187 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:05:34 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-4ae278b8-762b-48b7-8570-f5bfd6d5bb10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:34 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-4ae278b8-762b-48b7-8570-f5bfd6d5bb10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4ae278b8-762b-48b7-8570-f5bfd6d5bb10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4ae278b8-762b-48b7-8570-f5bfd6d5bb10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4ae278b8-762b-48b7-8570-f5bfd6d5bb10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4ae278b8-762b-48b7-8570-f5bfd6d5bb10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4ae278b8-762b-48b7-8570-f5bfd6d5bb10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4ae278b8-762b-48b7-8570-f5bfd6d5bb10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:35 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-04ad1038-829c-4c68-9737-e34cd07391f4 req-5023f9b0-8775-4559-b40c-b25f3b0e1b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a83b839-7b5b-4004-94da-d196d18caf0f", "name": "network-vif-plugged", "status": "completed", "tag": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-4ae278b8-762b-48b7-8570-f5bfd6d5bb10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments/a4613e4b-c3e6-4a25-bc39-1a81569e6916" status: 200 len: 194 microversion: 2.1 time: 0.083325 Apr 13 23:05:35 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 210/637] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 23:05:34 2023] GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments/a4613e4b-c3e6-4a25-bc39-1a81569e6916 => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-04ad1038-829c-4c68-9737-e34cd07391f4 req-5023f9b0-8775-4559-b40c-b25f3b0e1b3c service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-04ad1038-829c-4c68-9737-e34cd07391f4 req-5023f9b0-8775-4559-b40c-b25f3b0e1b3c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-04ad1038-829c-4c68-9737-e34cd07391f4 req-5023f9b0-8775-4559-b40c-b25f3b0e1b3c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:35 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:05:35 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:05:35 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:35 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:35 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-04ad1038-829c-4c68-9737-e34cd07391f4 req-5023f9b0-8775-4559-b40c-b25f3b0e1b3c service nova] Creating event network-vif-plugged:a88bc4ee-b024-4d26-9e56-e60daf6ef5fa for instance 1a83b839-7b5b-4004-94da-d196d18caf0f on user Apr 13 23:05:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:35 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-04ad1038-829c-4c68-9737-e34cd07391f4 req-5023f9b0-8775-4559-b40c-b25f3b0e1b3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040902 Apr 13 23:05:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:35 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 213/638] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:05:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:35 user devstack@n-api.service[61613]: DEBUG nova.objects.instance [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'services' on Instance uuid 381385a1-4c41-4479-b5cc-0222c9a7c2aa {{(pid=61613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:05:35 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments/a4613e4b-c3e6-4a25-bc39-1a81569e6916" status: 202 len: 0 microversion: 2.1 time: 0.208319 Apr 13 23:05:35 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 216/639] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 23:05:35 2023] DELETE /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments/a4613e4b-c3e6-4a25-bc39-1a81569e6916 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:05:37 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-fab4aff3-4407-4e32-a28a-c5a8c208ef5b req-0bfa5133-219c-4ea3-b614-918646e52b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a83b839-7b5b-4004-94da-d196d18caf0f", "name": "network-vif-plugged", "status": "completed", "tag": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:37 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:05:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-fab4aff3-4407-4e32-a28a-c5a8c208ef5b req-0bfa5133-219c-4ea3-b614-918646e52b22 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-fab4aff3-4407-4e32-a28a-c5a8c208ef5b req-0bfa5133-219c-4ea3-b614-918646e52b22 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-fab4aff3-4407-4e32-a28a-c5a8c208ef5b req-0bfa5133-219c-4ea3-b614-918646e52b22 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:37 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-fab4aff3-4407-4e32-a28a-c5a8c208ef5b req-0bfa5133-219c-4ea3-b614-918646e52b22 service nova] Creating event network-vif-plugged:a88bc4ee-b024-4d26-9e56-e60daf6ef5fa for instance 1a83b839-7b5b-4004-94da-d196d18caf0f on user Apr 13 23:05:37 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-fab4aff3-4407-4e32-a28a-c5a8c208ef5b req-0bfa5133-219c-4ea3-b614-918646e52b22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034533 Apr 13 23:05:37 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 211/640] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:05:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:37 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-3586f9ba-e922-43bf-a85c-946903c964cf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:37 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-3586f9ba-e922-43bf-a85c-946903c964cf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3586f9ba-e922-43bf-a85c-946903c964cf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3586f9ba-e922-43bf-a85c-946903c964cf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3586f9ba-e922-43bf-a85c-946903c964cf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3586f9ba-e922-43bf-a85c-946903c964cf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3586f9ba-e922-43bf-a85c-946903c964cf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3586f9ba-e922-43bf-a85c-946903c964cf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:37 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-3586f9ba-e922-43bf-a85c-946903c964cf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052319 Apr 13 23:05:37 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 214/641] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:05:37 2023] GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 23:05:37 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-0bb331d4-0ef6-451c-b2db-ad9628916da4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:37 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-0bb331d4-0ef6-451c-b2db-ad9628916da4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0bb331d4-0ef6-451c-b2db-ad9628916da4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0bb331d4-0ef6-451c-b2db-ad9628916da4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0bb331d4-0ef6-451c-b2db-ad9628916da4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0bb331d4-0ef6-451c-b2db-ad9628916da4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0bb331d4-0ef6-451c-b2db-ad9628916da4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0bb331d4-0ef6-451c-b2db-ad9628916da4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:37 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-0bb331d4-0ef6-451c-b2db-ad9628916da4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050332 Apr 13 23:05:37 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 217/642] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:05:37 2023] GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 23:05:37 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:37 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:37 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:05:37 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa" status: 204 len: 0 microversion: 2.1 time: 0.135309 Apr 13 23:05:37 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 212/643] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:05:37 2023] DELETE /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:05:37 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-0701344a-2a90-45cb-b179-f5779c60e69d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:37 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-0701344a-2a90-45cb-b179-f5779c60e69d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0701344a-2a90-45cb-b179-f5779c60e69d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0701344a-2a90-45cb-b179-f5779c60e69d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0701344a-2a90-45cb-b179-f5779c60e69d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0701344a-2a90-45cb-b179-f5779c60e69d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0701344a-2a90-45cb-b179-f5779c60e69d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0701344a-2a90-45cb-b179-f5779c60e69d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:38 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-0701344a-2a90-45cb-b179-f5779c60e69d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b46af525dd45678b69207e93683ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0648ea953174a8cae6085ac24d92bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:05:38 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-0701344a-2a90-45cb-b179-f5779c60e69d tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa" status: 200 len: 1662 microversion: 2.1 time: 0.288607 Apr 13 23:05:38 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 215/644] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:05:37 2023] GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa => generated 1662 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 23:05:38 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-3ca3d784-c11c-440a-9be0-5dc25159f7ea req-a9587ae8-c55e-4644-a931-3ceb0bd832a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "381385a1-4c41-4479-b5cc-0222c9a7c2aa", "name": "network-vif-unplugged", "status": "completed", "tag": "b8721edc-dc82-4768-a1ae-894b8561f8a8"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3ca3d784-c11c-440a-9be0-5dc25159f7ea req-a9587ae8-c55e-4644-a931-3ceb0bd832a0 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3ca3d784-c11c-440a-9be0-5dc25159f7ea req-a9587ae8-c55e-4644-a931-3ceb0bd832a0 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3ca3d784-c11c-440a-9be0-5dc25159f7ea req-a9587ae8-c55e-4644-a931-3ceb0bd832a0 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:38 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-3ca3d784-c11c-440a-9be0-5dc25159f7ea req-a9587ae8-c55e-4644-a931-3ceb0bd832a0 service nova] Creating event network-vif-unplugged:b8721edc-dc82-4768-a1ae-894b8561f8a8 for instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa on user Apr 13 23:05:38 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-3ca3d784-c11c-440a-9be0-5dc25159f7ea req-a9587ae8-c55e-4644-a931-3ceb0bd832a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032212 Apr 13 23:05:38 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 218/645] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:05:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:39 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-057f771f-2895-4a4c-aba6-c15ef0c8997c req-9875184e-7c6a-4092-a7c4-44a6525a42b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "381385a1-4c41-4479-b5cc-0222c9a7c2aa", "name": "network-vif-deleted", "tag": "b8721edc-dc82-4768-a1ae-894b8561f8a8"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-057f771f-2895-4a4c-aba6-c15ef0c8997c req-9875184e-7c6a-4092-a7c4-44a6525a42b5 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-057f771f-2895-4a4c-aba6-c15ef0c8997c req-9875184e-7c6a-4092-a7c4-44a6525a42b5 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-057f771f-2895-4a4c-aba6-c15ef0c8997c req-9875184e-7c6a-4092-a7c4-44a6525a42b5 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:39 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-057f771f-2895-4a4c-aba6-c15ef0c8997c req-9875184e-7c6a-4092-a7c4-44a6525a42b5 service nova] Creating event network-vif-deleted:b8721edc-dc82-4768-a1ae-894b8561f8a8 for instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa on user Apr 13 23:05:39 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-057f771f-2895-4a4c-aba6-c15ef0c8997c req-9875184e-7c6a-4092-a7c4-44a6525a42b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040186 Apr 13 23:05:39 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 213/646] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:05:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 23:05:40 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-70acae1d-91a8-429e-bb60-8b67ab648ef6 req-7a4da5fe-5403-48ed-a3e0-5ca1bf72e47b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "381385a1-4c41-4479-b5cc-0222c9a7c2aa", "name": "network-vif-plugged", "status": "completed", "tag": "b8721edc-dc82-4768-a1ae-894b8561f8a8"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:40 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-70acae1d-91a8-429e-bb60-8b67ab648ef6 req-7a4da5fe-5403-48ed-a3e0-5ca1bf72e47b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:40 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-70acae1d-91a8-429e-bb60-8b67ab648ef6 req-7a4da5fe-5403-48ed-a3e0-5ca1bf72e47b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:40 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-70acae1d-91a8-429e-bb60-8b67ab648ef6 req-7a4da5fe-5403-48ed-a3e0-5ca1bf72e47b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:40 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:05:40 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-70acae1d-91a8-429e-bb60-8b67ab648ef6 req-7a4da5fe-5403-48ed-a3e0-5ca1bf72e47b service nova] Creating event network-vif-plugged:b8721edc-dc82-4768-a1ae-894b8561f8a8 for instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa on user Apr 13 23:05:40 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-70acae1d-91a8-429e-bb60-8b67ab648ef6 req-7a4da5fe-5403-48ed-a3e0-5ca1bf72e47b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038748 Apr 13 23:05:40 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 216/647] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:05:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 23:05:41 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-961d6d76-c837-41b9-b38c-eea6222e2d2a tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:41 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-961d6d76-c837-41b9-b38c-eea6222e2d2a tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-961d6d76-c837-41b9-b38c-eea6222e2d2a tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-961d6d76-c837-41b9-b38c-eea6222e2d2a tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-961d6d76-c837-41b9-b38c-eea6222e2d2a tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-961d6d76-c837-41b9-b38c-eea6222e2d2a tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-961d6d76-c837-41b9-b38c-eea6222e2d2a tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-961d6d76-c837-41b9-b38c-eea6222e2d2a tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:41 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-961d6d76-c837-41b9-b38c-eea6222e2d2a tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:05:41 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-961d6d76-c837-41b9-b38c-eea6222e2d2a tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2" status: 200 len: 1747 microversion: 2.1 time: 0.161516 Apr 13 23:05:41 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 219/648] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:05:41 2023] GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2 => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:05:53 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:05:53 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:05:53 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-e0a19851-65d8-4dc5-b9cc-5284c2cb4ba2 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:53 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-e0a19851-65d8-4dc5-b9cc-5284c2cb4ba2 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e0a19851-65d8-4dc5-b9cc-5284c2cb4ba2 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e0a19851-65d8-4dc5-b9cc-5284c2cb4ba2 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e0a19851-65d8-4dc5-b9cc-5284c2cb4ba2 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e0a19851-65d8-4dc5-b9cc-5284c2cb4ba2 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e0a19851-65d8-4dc5-b9cc-5284c2cb4ba2 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e0a19851-65d8-4dc5-b9cc-5284c2cb4ba2 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:53 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-e0a19851-65d8-4dc5-b9cc-5284c2cb4ba2 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:05:53 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-e0a19851-65d8-4dc5-b9cc-5284c2cb4ba2 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:05:53 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-e0a19851-65d8-4dc5-b9cc-5284c2cb4ba2 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:05:53 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-e0a19851-65d8-4dc5-b9cc-5284c2cb4ba2 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" status: 200 len: 1690 microversion: 2.87 time: 0.183481 Apr 13 23:05:53 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 214/649] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:05:53 2023] GET /compute/v2.1/servers/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 => generated 1690 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:05:55 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=19 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:05:55 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:55 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:55 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Going to try to terminate instance {{(pid=61612) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:05:55 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/47dce1cc-c872-41f3-81af-acfc6ccabe18" status: 204 len: 0 microversion: 2.1 time: 0.110445 Apr 13 23:05:55 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 217/650] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:05:55 2023] DELETE /compute/v2.1/servers/47dce1cc-c872-41f3-81af-acfc6ccabe18 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:05:55 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-9070c446-660f-45f2-9b4b-a7297a472ad1 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:55 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-9070c446-660f-45f2-9b4b-a7297a472ad1 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:55 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:05:55 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:05:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-9070c446-660f-45f2-9b4b-a7297a472ad1 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-9070c446-660f-45f2-9b4b-a7297a472ad1 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-9070c446-660f-45f2-9b4b-a7297a472ad1 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-9070c446-660f-45f2-9b4b-a7297a472ad1 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-9070c446-660f-45f2-9b4b-a7297a472ad1 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-9070c446-660f-45f2-9b4b-a7297a472ad1 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:56 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-9070c446-660f-45f2-9b4b-a7297a472ad1 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71593deacbd74fea9fc2faf5a9b08877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a3c684b0414336b2ca770eb1f3ab17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:05:56 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-9070c446-660f-45f2-9b4b-a7297a472ad1 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47dce1cc-c872-41f3-81af-acfc6ccabe18" status: 200 len: 1500 microversion: 2.1 time: 0.182144 Apr 13 23:05:56 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 220/651] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:05:55 2023] GET /compute/v2.1/servers/47dce1cc-c872-41f3-81af-acfc6ccabe18 => generated 1500 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:05:56 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-f4e46257-82a3-4982-818a-f1d5d570c5f3 req-055b8c17-f7e0-4372-9737-73aa33c06172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47dce1cc-c872-41f3-81af-acfc6ccabe18", "name": "network-vif-unplugged", "status": "completed", "tag": "6ab4b160-3952-4332-9443-7f743c5feb6c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f4e46257-82a3-4982-818a-f1d5d570c5f3 req-055b8c17-f7e0-4372-9737-73aa33c06172 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f4e46257-82a3-4982-818a-f1d5d570c5f3 req-055b8c17-f7e0-4372-9737-73aa33c06172 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f4e46257-82a3-4982-818a-f1d5d570c5f3 req-055b8c17-f7e0-4372-9737-73aa33c06172 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:56 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-f4e46257-82a3-4982-818a-f1d5d570c5f3 req-055b8c17-f7e0-4372-9737-73aa33c06172 service nova] Creating event network-vif-unplugged:6ab4b160-3952-4332-9443-7f743c5feb6c for instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 on user Apr 13 23:05:56 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-f4e46257-82a3-4982-818a-f1d5d570c5f3 req-055b8c17-f7e0-4372-9737-73aa33c06172 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029733 Apr 13 23:05:56 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 215/652] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:05:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:57 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-b5e25d1e-23ac-46e4-94b6-ea0234ae0c68 req-8decb261-f6e8-4486-9c24-e037cfcc004f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47dce1cc-c872-41f3-81af-acfc6ccabe18", "name": "network-vif-deleted", "tag": "6ab4b160-3952-4332-9443-7f743c5feb6c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b5e25d1e-23ac-46e4-94b6-ea0234ae0c68 req-8decb261-f6e8-4486-9c24-e037cfcc004f service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b5e25d1e-23ac-46e4-94b6-ea0234ae0c68 req-8decb261-f6e8-4486-9c24-e037cfcc004f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b5e25d1e-23ac-46e4-94b6-ea0234ae0c68 req-8decb261-f6e8-4486-9c24-e037cfcc004f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:57 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-b5e25d1e-23ac-46e4-94b6-ea0234ae0c68 req-8decb261-f6e8-4486-9c24-e037cfcc004f service nova] Creating event network-vif-deleted:6ab4b160-3952-4332-9443-7f743c5feb6c for instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 on user Apr 13 23:05:57 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-b5e25d1e-23ac-46e4-94b6-ea0234ae0c68 req-8decb261-f6e8-4486-9c24-e037cfcc004f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028335 Apr 13 23:05:57 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 218/653] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:05:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:57 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-521f9366-d868-4b89-aab4-efbf3349c339 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:57 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-521f9366-d868-4b89-aab4-efbf3349c339 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-521f9366-d868-4b89-aab4-efbf3349c339 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-521f9366-d868-4b89-aab4-efbf3349c339 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-521f9366-d868-4b89-aab4-efbf3349c339 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-521f9366-d868-4b89-aab4-efbf3349c339 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-521f9366-d868-4b89-aab4-efbf3349c339 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-521f9366-d868-4b89-aab4-efbf3349c339 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:58 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-521f9366-d868-4b89-aab4-efbf3349c339 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.129616 Apr 13 23:05:58 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 221/654] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 23:05:57 2023] GET /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875/os-interface => generated 1829 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:05:58 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-4dfb2831-7f37-4bf2-94ff-f36040c1a5c2 req-6f942056-eb24-431c-8e09-12c327e0860c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47dce1cc-c872-41f3-81af-acfc6ccabe18", "name": "network-vif-plugged", "status": "completed", "tag": "6ab4b160-3952-4332-9443-7f743c5feb6c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-4dfb2831-7f37-4bf2-94ff-f36040c1a5c2 req-6f942056-eb24-431c-8e09-12c327e0860c service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-4dfb2831-7f37-4bf2-94ff-f36040c1a5c2 req-6f942056-eb24-431c-8e09-12c327e0860c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-4dfb2831-7f37-4bf2-94ff-f36040c1a5c2 req-6f942056-eb24-431c-8e09-12c327e0860c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-4dfb2831-7f37-4bf2-94ff-f36040c1a5c2 req-6f942056-eb24-431c-8e09-12c327e0860c service nova] Creating event network-vif-plugged:6ab4b160-3952-4332-9443-7f743c5feb6c for instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 on user Apr 13 23:05:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-4dfb2831-7f37-4bf2-94ff-f36040c1a5c2 req-6f942056-eb24-431c-8e09-12c327e0860c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034166 Apr 13 23:05:58 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 216/655] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:05:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:58 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-9447326b-2589-4b9c-889b-e8c7805b1a4e req-c5309e8b-3cbc-4ba5-ba71-daa0f8cccb8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "tag": "03889253-8210-430d-b5a9-47d58c066803"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:05:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-9447326b-2589-4b9c-889b-e8c7805b1a4e req-c5309e8b-3cbc-4ba5-ba71-daa0f8cccb8c service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-9447326b-2589-4b9c-889b-e8c7805b1a4e req-c5309e8b-3cbc-4ba5-ba71-daa0f8cccb8c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-9447326b-2589-4b9c-889b-e8c7805b1a4e req-c5309e8b-3cbc-4ba5-ba71-daa0f8cccb8c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:58 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-9447326b-2589-4b9c-889b-e8c7805b1a4e req-c5309e8b-3cbc-4ba5-ba71-daa0f8cccb8c service nova] Creating event network-changed:03889253-8210-430d-b5a9-47d58c066803 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:05:58 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-9447326b-2589-4b9c-889b-e8c7805b1a4e req-c5309e8b-3cbc-4ba5-ba71-daa0f8cccb8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031297 Apr 13 23:05:58 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 219/656] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:05:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:05:58 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-72d5b49f-5a09-4230-8921-0060c895378c tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:58 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-72d5b49f-5a09-4230-8921-0060c895378c tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-72d5b49f-5a09-4230-8921-0060c895378c tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-72d5b49f-5a09-4230-8921-0060c895378c tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-72d5b49f-5a09-4230-8921-0060c895378c tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-72d5b49f-5a09-4230-8921-0060c895378c tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-72d5b49f-5a09-4230-8921-0060c895378c tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-72d5b49f-5a09-4230-8921-0060c895378c tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:59 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-72d5b49f-5a09-4230-8921-0060c895378c tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc4aba6767a4af9899ac437ab183df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822a2f291ff497aaaf66c26ed6afc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:05:59 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-72d5b49f-5a09-4230-8921-0060c895378c tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fc4aba6767a4af9899ac437ab183df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822a2f291ff497aaaf66c26ed6afc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:05:59 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-72d5b49f-5a09-4230-8921-0060c895378c tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fc4aba6767a4af9899ac437ab183df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822a2f291ff497aaaf66c26ed6afc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:05:59 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-72d5b49f-5a09-4230-8921-0060c895378c tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875" status: 200 len: 2828 microversion: 2.42 time: 0.477296 Apr 13 23:05:59 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 222/657] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:05:58 2023] GET /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875 => generated 2828 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:05:59 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f0e3a5ea-9bf7-4850-9e04-2b88808ac5a1 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:05:59 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f0e3a5ea-9bf7-4850-9e04-2b88808ac5a1 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:05:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0e3a5ea-9bf7-4850-9e04-2b88808ac5a1 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0e3a5ea-9bf7-4850-9e04-2b88808ac5a1 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0e3a5ea-9bf7-4850-9e04-2b88808ac5a1 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0e3a5ea-9bf7-4850-9e04-2b88808ac5a1 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:05:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0e3a5ea-9bf7-4850-9e04-2b88808ac5a1 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:05:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0e3a5ea-9bf7-4850-9e04-2b88808ac5a1 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:05:59 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f0e3a5ea-9bf7-4850-9e04-2b88808ac5a1 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.134979 Apr 13 23:05:59 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 217/658] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 23:05:59 2023] GET /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875/os-interface => generated 1829 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:06:00 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:00 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:00 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Going to try to terminate instance {{(pid=61612) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:06:00 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875" status: 204 len: 0 microversion: 2.42 time: 0.126101 Apr 13 23:06:00 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 220/659] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 23:06:00 2023] DELETE /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 23:06:00 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e3f14639-eea1-4efa-848c-f645188f03dc tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:00 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-e3f14639-eea1-4efa-848c-f645188f03dc tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:00 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e3f14639-eea1-4efa-848c-f645188f03dc tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:00 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e3f14639-eea1-4efa-848c-f645188f03dc tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:00 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e3f14639-eea1-4efa-848c-f645188f03dc tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:00 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e3f14639-eea1-4efa-848c-f645188f03dc tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:00 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e3f14639-eea1-4efa-848c-f645188f03dc tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:00 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e3f14639-eea1-4efa-848c-f645188f03dc tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:00 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-e3f14639-eea1-4efa-848c-f645188f03dc tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc4aba6767a4af9899ac437ab183df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822a2f291ff497aaaf66c26ed6afc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:06:00 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-e3f14639-eea1-4efa-848c-f645188f03dc tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fc4aba6767a4af9899ac437ab183df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822a2f291ff497aaaf66c26ed6afc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:06:00 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-e3f14639-eea1-4efa-848c-f645188f03dc tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fc4aba6767a4af9899ac437ab183df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822a2f291ff497aaaf66c26ed6afc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:06:00 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-e3f14639-eea1-4efa-848c-f645188f03dc tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875" status: 200 len: 2952 microversion: 2.42 time: 0.253973 Apr 13 23:06:00 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 223/660] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:06:00 2023] GET /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875 => generated 2952 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:06:00 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-ace390fb-c02c-4a6d-8b11-e66e035aa457 req-5aac1861-401d-4e11-b42e-e7922a869d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-unplugged", "status": "completed", "tag": "03889253-8210-430d-b5a9-47d58c066803"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:06:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-ace390fb-c02c-4a6d-8b11-e66e035aa457 req-5aac1861-401d-4e11-b42e-e7922a869d30 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-ace390fb-c02c-4a6d-8b11-e66e035aa457 req-5aac1861-401d-4e11-b42e-e7922a869d30 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-ace390fb-c02c-4a6d-8b11-e66e035aa457 req-5aac1861-401d-4e11-b42e-e7922a869d30 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:01 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-ace390fb-c02c-4a6d-8b11-e66e035aa457 req-5aac1861-401d-4e11-b42e-e7922a869d30 service nova] Creating event network-vif-unplugged:03889253-8210-430d-b5a9-47d58c066803 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:06:01 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-ace390fb-c02c-4a6d-8b11-e66e035aa457 req-5aac1861-401d-4e11-b42e-e7922a869d30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039969 Apr 13 23:06:01 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 218/661] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:06:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:06:01 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-f18feb95-3bfd-4399-b842-36b63cb46922 req-0864a41b-d5e0-4788-9778-88e08b5fd73d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-unplugged", "status": "completed", "tag": "77b2db4a-b1bb-4628-a21a-1e24199cf117"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:06:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f18feb95-3bfd-4399-b842-36b63cb46922 req-0864a41b-d5e0-4788-9778-88e08b5fd73d service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f18feb95-3bfd-4399-b842-36b63cb46922 req-0864a41b-d5e0-4788-9778-88e08b5fd73d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f18feb95-3bfd-4399-b842-36b63cb46922 req-0864a41b-d5e0-4788-9778-88e08b5fd73d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:01 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f18feb95-3bfd-4399-b842-36b63cb46922 req-0864a41b-d5e0-4788-9778-88e08b5fd73d service nova] Creating event network-vif-unplugged:77b2db4a-b1bb-4628-a21a-1e24199cf117 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:06:01 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-f18feb95-3bfd-4399-b842-36b63cb46922 req-0864a41b-d5e0-4788-9778-88e08b5fd73d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030048 Apr 13 23:06:01 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 221/662] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:06:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:06:01 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-4013cb2d-9c90-462c-9cce-50853dcb225c req-4cc4f527-4372-408c-8d49-080791d6f0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-unplugged", "status": "completed", "tag": "56cd2acf-5e6d-4703-a160-2cf983399d6b"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:06:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4013cb2d-9c90-462c-9cce-50853dcb225c req-4cc4f527-4372-408c-8d49-080791d6f0db service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4013cb2d-9c90-462c-9cce-50853dcb225c req-4cc4f527-4372-408c-8d49-080791d6f0db service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4013cb2d-9c90-462c-9cce-50853dcb225c req-4cc4f527-4372-408c-8d49-080791d6f0db service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:01 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-4013cb2d-9c90-462c-9cce-50853dcb225c req-4cc4f527-4372-408c-8d49-080791d6f0db service nova] Creating event network-vif-unplugged:56cd2acf-5e6d-4703-a160-2cf983399d6b for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:06:01 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-4013cb2d-9c90-462c-9cce-50853dcb225c req-4cc4f527-4372-408c-8d49-080791d6f0db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031200 Apr 13 23:06:01 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 224/663] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:06:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:06:03 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "03889253-8210-430d-b5a9-47d58c066803"}, {"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-unplugged", "status": "completed", "tag": "d6a692ff-983e-4d9b-abb2-45fee280cb60"}, {"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "d6a692ff-983e-4d9b-abb2-45fee280cb60"}, {"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-unplugged", "status": "completed", "tag": "ad651a01-eb81-4baf-8b6c-ff196a729d67"}, {"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "ad651a01-eb81-4baf-8b6c-ff196a729d67"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:06:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:03 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Creating event network-vif-plugged:03889253-8210-430d-b5a9-47d58c066803 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:06:03 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Creating event network-vif-unplugged:d6a692ff-983e-4d9b-abb2-45fee280cb60 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:06:03 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Creating event network-vif-plugged:d6a692ff-983e-4d9b-abb2-45fee280cb60 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:06:03 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Creating event network-vif-unplugged:ad651a01-eb81-4baf-8b6c-ff196a729d67 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:06:03 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Creating event network-vif-plugged:ad651a01-eb81-4baf-8b6c-ff196a729d67 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:06:03 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.034580 Apr 13 23:06:03 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 219/664] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:06:03 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:06:03 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "77b2db4a-b1bb-4628-a21a-1e24199cf117"}, {"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-unplugged", "status": "completed", "tag": "ec62d21a-cab5-4c13-85df-0e7134cc11d3"}, {"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "ec62d21a-cab5-4c13-85df-0e7134cc11d3"}, {"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-unplugged", "status": "completed", "tag": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e"}, {"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:06:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:03 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Creating event network-vif-plugged:77b2db4a-b1bb-4628-a21a-1e24199cf117 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:06:03 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Creating event network-vif-unplugged:ec62d21a-cab5-4c13-85df-0e7134cc11d3 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:06:03 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Creating event network-vif-plugged:ec62d21a-cab5-4c13-85df-0e7134cc11d3 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:06:03 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Creating event network-vif-unplugged:a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:06:03 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Creating event network-vif-plugged:a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:06:03 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.033590 Apr 13 23:06:03 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 222/665] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:06:03 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:06:03 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-c5e9ff4d-7930-4188-92b2-7a83c2737c37 req-565155c2-1416-41a6-8740-ab5dc34b7ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-plugged", "status": "completed", "tag": "56cd2acf-5e6d-4703-a160-2cf983399d6b"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:06:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c5e9ff4d-7930-4188-92b2-7a83c2737c37 req-565155c2-1416-41a6-8740-ab5dc34b7ddf service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c5e9ff4d-7930-4188-92b2-7a83c2737c37 req-565155c2-1416-41a6-8740-ab5dc34b7ddf service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c5e9ff4d-7930-4188-92b2-7a83c2737c37 req-565155c2-1416-41a6-8740-ab5dc34b7ddf service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:03 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-c5e9ff4d-7930-4188-92b2-7a83c2737c37 req-565155c2-1416-41a6-8740-ab5dc34b7ddf service nova] Creating event network-vif-plugged:56cd2acf-5e6d-4703-a160-2cf983399d6b for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:06:03 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-c5e9ff4d-7930-4188-92b2-7a83c2737c37 req-565155c2-1416-41a6-8740-ab5dc34b7ddf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032399 Apr 13 23:06:03 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 225/666] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:06:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:06:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-de43dcb3-9aec-4040-8cdb-cba83414c385 req-95f3e7b7-5e7c-431d-b78d-34541c6c5b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-deleted", "tag": "ad651a01-eb81-4baf-8b6c-ff196a729d67"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:06:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-de43dcb3-9aec-4040-8cdb-cba83414c385 req-95f3e7b7-5e7c-431d-b78d-34541c6c5b6f service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-de43dcb3-9aec-4040-8cdb-cba83414c385 req-95f3e7b7-5e7c-431d-b78d-34541c6c5b6f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-de43dcb3-9aec-4040-8cdb-cba83414c385 req-95f3e7b7-5e7c-431d-b78d-34541c6c5b6f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:05 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-de43dcb3-9aec-4040-8cdb-cba83414c385 req-95f3e7b7-5e7c-431d-b78d-34541c6c5b6f service nova] Creating event network-vif-deleted:ad651a01-eb81-4baf-8b6c-ff196a729d67 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:06:05 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-de43dcb3-9aec-4040-8cdb-cba83414c385 req-95f3e7b7-5e7c-431d-b78d-34541c6c5b6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032954 Apr 13 23:06:05 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 220/667] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:06:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:06:07 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-f0940778-c074-42ec-b5b8-d10c688e4db8 req-2af4e697-14ee-422c-8375-deb476d66237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-deleted", "tag": "d6a692ff-983e-4d9b-abb2-45fee280cb60"}, {"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-deleted", "tag": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e"}, {"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-deleted", "tag": "56cd2acf-5e6d-4703-a160-2cf983399d6b"}, {"server_uuid": "10290935-3f12-4e11-9495-f9c037e89875", "name": "network-vif-deleted", "tag": "03889253-8210-430d-b5a9-47d58c066803"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:06:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f0940778-c074-42ec-b5b8-d10c688e4db8 req-2af4e697-14ee-422c-8375-deb476d66237 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f0940778-c074-42ec-b5b8-d10c688e4db8 req-2af4e697-14ee-422c-8375-deb476d66237 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f0940778-c074-42ec-b5b8-d10c688e4db8 req-2af4e697-14ee-422c-8375-deb476d66237 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f0940778-c074-42ec-b5b8-d10c688e4db8 req-2af4e697-14ee-422c-8375-deb476d66237 service nova] Creating event network-vif-deleted:d6a692ff-983e-4d9b-abb2-45fee280cb60 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:06:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f0940778-c074-42ec-b5b8-d10c688e4db8 req-2af4e697-14ee-422c-8375-deb476d66237 service nova] Creating event network-vif-deleted:a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:06:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f0940778-c074-42ec-b5b8-d10c688e4db8 req-2af4e697-14ee-422c-8375-deb476d66237 service nova] Creating event network-vif-deleted:56cd2acf-5e6d-4703-a160-2cf983399d6b for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:06:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f0940778-c074-42ec-b5b8-d10c688e4db8 req-2af4e697-14ee-422c-8375-deb476d66237 service nova] Creating event network-vif-deleted:03889253-8210-430d-b5a9-47d58c066803 for instance 10290935-3f12-4e11-9495-f9c037e89875 on user Apr 13 23:06:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-f0940778-c074-42ec-b5b8-d10c688e4db8 req-2af4e697-14ee-422c-8375-deb476d66237 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.031752 Apr 13 23:06:07 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 223/668] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:06:07 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:06:12 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-3ed3528a-055d-4d30-82ae-1feb12e89b1e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:12 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-3ed3528a-055d-4d30-82ae-1feb12e89b1e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3ed3528a-055d-4d30-82ae-1feb12e89b1e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3ed3528a-055d-4d30-82ae-1feb12e89b1e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3ed3528a-055d-4d30-82ae-1feb12e89b1e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3ed3528a-055d-4d30-82ae-1feb12e89b1e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3ed3528a-055d-4d30-82ae-1feb12e89b1e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3ed3528a-055d-4d30-82ae-1feb12e89b1e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:12 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-3ed3528a-055d-4d30-82ae-1feb12e89b1e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:06:12 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-3ed3528a-055d-4d30-82ae-1feb12e89b1e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195" status: 200 len: 1718 microversion: 2.1 time: 0.145305 Apr 13 23:06:12 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 226/669] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:06:12 2023] GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:06:15 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-bcb747aa-01a6-4547-a1ae-f226176af771 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:15 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-bcb747aa-01a6-4547-a1ae-f226176af771 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bcb747aa-01a6-4547-a1ae-f226176af771 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bcb747aa-01a6-4547-a1ae-f226176af771 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bcb747aa-01a6-4547-a1ae-f226176af771 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bcb747aa-01a6-4547-a1ae-f226176af771 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bcb747aa-01a6-4547-a1ae-f226176af771 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bcb747aa-01a6-4547-a1ae-f226176af771 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:15 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-dff203da-9379-4020-9875-dd4316239946 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:15 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-dff203da-9379-4020-9875-dd4316239946 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:15 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-bcb747aa-01a6-4547-a1ae-f226176af771 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:06:15 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-bcb747aa-01a6-4547-a1ae-f226176af771 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a83b839-7b5b-4004-94da-d196d18caf0f" status: 200 len: 1440 microversion: 2.1 time: 0.268018 Apr 13 23:06:15 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 221/670] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:06:15 2023] GET /compute/v2.1/servers/1a83b839-7b5b-4004-94da-d196d18caf0f => generated 1440 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:06:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dff203da-9379-4020-9875-dd4316239946 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dff203da-9379-4020-9875-dd4316239946 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dff203da-9379-4020-9875-dd4316239946 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dff203da-9379-4020-9875-dd4316239946 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dff203da-9379-4020-9875-dd4316239946 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dff203da-9379-4020-9875-dd4316239946 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:15 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-dff203da-9379-4020-9875-dd4316239946 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.312917 Apr 13 23:06:15 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 224/671] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:06:15 2023] GET /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889/os-volume_attachments => generated 25 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 23:06:15 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:15 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:15 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:06:15 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889" status: 204 len: 0 microversion: 2.1 time: 0.110327 Apr 13 23:06:15 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 227/672] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:06:15 2023] DELETE /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:06:15 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-224bdbb2-7d4d-4401-8185-e45af3644a43 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:15 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-224bdbb2-7d4d-4401-8185-e45af3644a43 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-224bdbb2-7d4d-4401-8185-e45af3644a43 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-224bdbb2-7d4d-4401-8185-e45af3644a43 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-224bdbb2-7d4d-4401-8185-e45af3644a43 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-224bdbb2-7d4d-4401-8185-e45af3644a43 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-224bdbb2-7d4d-4401-8185-e45af3644a43 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-224bdbb2-7d4d-4401-8185-e45af3644a43 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:16 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-224bdbb2-7d4d-4401-8185-e45af3644a43 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98594f3f6ccf4ffdbfd91bcf192d936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ccac99656842aca44f9f1eb7aa167a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:06:16 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-224bdbb2-7d4d-4401-8185-e45af3644a43 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889" status: 200 len: 1668 microversion: 2.1 time: 0.188798 Apr 13 23:06:16 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 222/673] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:06:15 2023] GET /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889 => generated 1668 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 23:06:16 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-283987d3-f0b6-4f4c-a4f1-dfecd8242b77 req-641cc86f-18a5-4945-8f00-43943edf577b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454fafc9-4b6f-40c3-80fa-d590fb946889", "name": "network-vif-unplugged", "status": "completed", "tag": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:06:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-283987d3-f0b6-4f4c-a4f1-dfecd8242b77 req-641cc86f-18a5-4945-8f00-43943edf577b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-283987d3-f0b6-4f4c-a4f1-dfecd8242b77 req-641cc86f-18a5-4945-8f00-43943edf577b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-283987d3-f0b6-4f4c-a4f1-dfecd8242b77 req-641cc86f-18a5-4945-8f00-43943edf577b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:16 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-283987d3-f0b6-4f4c-a4f1-dfecd8242b77 req-641cc86f-18a5-4945-8f00-43943edf577b service nova] Creating event network-vif-unplugged:4eef61bd-3529-4ab4-9f58-881fac9cc1d6 for instance 454fafc9-4b6f-40c3-80fa-d590fb946889 on user Apr 13 23:06:16 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-283987d3-f0b6-4f4c-a4f1-dfecd8242b77 req-641cc86f-18a5-4945-8f00-43943edf577b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027487 Apr 13 23:06:16 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 225/674] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:06:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:06:17 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-8c4a1358-5572-43fa-b115-543d25c53d06 req-d4747dc5-e9c2-4696-96d2-79aad17a97ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454fafc9-4b6f-40c3-80fa-d590fb946889", "name": "network-vif-deleted", "tag": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:06:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8c4a1358-5572-43fa-b115-543d25c53d06 req-d4747dc5-e9c2-4696-96d2-79aad17a97ef service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8c4a1358-5572-43fa-b115-543d25c53d06 req-d4747dc5-e9c2-4696-96d2-79aad17a97ef service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8c4a1358-5572-43fa-b115-543d25c53d06 req-d4747dc5-e9c2-4696-96d2-79aad17a97ef service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:17 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-8c4a1358-5572-43fa-b115-543d25c53d06 req-d4747dc5-e9c2-4696-96d2-79aad17a97ef service nova] Creating event network-vif-deleted:4eef61bd-3529-4ab4-9f58-881fac9cc1d6 for instance 454fafc9-4b6f-40c3-80fa-d590fb946889 on user Apr 13 23:06:17 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-8c4a1358-5572-43fa-b115-543d25c53d06 req-d4747dc5-e9c2-4696-96d2-79aad17a97ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038287 Apr 13 23:06:17 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 228/675] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:06:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:06:18 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-eaabe2a4-eddb-476e-b082-955d0c6f5d26 req-d605dffe-a7c9-4971-b5aa-dca439c77de4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454fafc9-4b6f-40c3-80fa-d590fb946889", "name": "network-vif-plugged", "status": "completed", "tag": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:06:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-eaabe2a4-eddb-476e-b082-955d0c6f5d26 req-d605dffe-a7c9-4971-b5aa-dca439c77de4 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-eaabe2a4-eddb-476e-b082-955d0c6f5d26 req-d605dffe-a7c9-4971-b5aa-dca439c77de4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-eaabe2a4-eddb-476e-b082-955d0c6f5d26 req-d605dffe-a7c9-4971-b5aa-dca439c77de4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-eaabe2a4-eddb-476e-b082-955d0c6f5d26 req-d605dffe-a7c9-4971-b5aa-dca439c77de4 service nova] Creating event network-vif-plugged:4eef61bd-3529-4ab4-9f58-881fac9cc1d6 for instance 454fafc9-4b6f-40c3-80fa-d590fb946889 on user Apr 13 23:06:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-eaabe2a4-eddb-476e-b082-955d0c6f5d26 req-d605dffe-a7c9-4971-b5aa-dca439c77de4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032719 Apr 13 23:06:18 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 223/676] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:06:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:06:28 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:06:28 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:06:28 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-6c965fd4-43cf-4bd5-a606-a9cb6d974d67 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:28 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-6c965fd4-43cf-4bd5-a606-a9cb6d974d67 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6c965fd4-43cf-4bd5-a606-a9cb6d974d67 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6c965fd4-43cf-4bd5-a606-a9cb6d974d67 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6c965fd4-43cf-4bd5-a606-a9cb6d974d67 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6c965fd4-43cf-4bd5-a606-a9cb6d974d67 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6c965fd4-43cf-4bd5-a606-a9cb6d974d67 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6c965fd4-43cf-4bd5-a606-a9cb6d974d67 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:28 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-6c965fd4-43cf-4bd5-a606-a9cb6d974d67 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] HTTP exception thrown: Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa could not be found. Apr 13 23:06:28 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-6c965fd4-43cf-4bd5-a606-a9cb6d974d67 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Request method failure captured: Apr 13 23:06:28 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa HTTP/1.1 Apr 13 23:06:28 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:06:28 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:06:28 user devstack@n-api.service[61612]: Connection: close Apr 13 23:06:28 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:06:28 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:06:28 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:06:28 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:06:28 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:06:28 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIfA8POs3fwPWdIWuED5bQRvy1sRPQ7bek3Y8_6hntA1E2vMW5JP4EbYd4WjeiKPkGYkQ0RbnlRV9PxsF2lw8jd7Bn8V3L0LhE5pzNTNHBFB9Xpzt7CoX84mD0x6WZrafVyEKTW01ClUMbS-tyN6oH8x8-VczX4_MbGFJ52_-5q5EIo Apr 13 23:06:28 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:06:28 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:06:28 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:06:28 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:06:28 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:06:28 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:06:28 user devstack@n-api.service[61612]: X-Project-Id: d0648ea953174a8cae6085ac24d92bb1 Apr 13 23:06:28 user devstack@n-api.service[61612]: X-Project-Name: tempest-AttachVolumeTestJSON-118072319 Apr 13 23:06:28 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:06:28 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:06:28 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d0648ea953174a8cae6085ac24d92bb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d0648ea953174a8cae6085ac24d92bb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d0648ea953174a8cae6085ac24d92bb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:06:28 user devstack@n-api.service[61612]: X-Tenant: tempest-AttachVolumeTestJSON-118072319 Apr 13 23:06:28 user devstack@n-api.service[61612]: X-Tenant-Id: d0648ea953174a8cae6085ac24d92bb1 Apr 13 23:06:28 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-AttachVolumeTestJSON-118072319 Apr 13 23:06:28 user devstack@n-api.service[61612]: X-User: tempest-AttachVolumeTestJSON-118072319-project-member Apr 13 23:06:28 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:06:28 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:06:28 user devstack@n-api.service[61612]: X-User-Id: 13b46af525dd45678b69207e93683ac4 Apr 13 23:06:28 user devstack@n-api.service[61612]: X-User-Name: tempest-AttachVolumeTestJSON-118072319-project-member Apr 13 23:06:28 user devstack@n-api.service[61612]: method: > Apr 13 23:06:28 user devstack@n-api.service[61612]: exception: Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa could not be found. Apr 13 23:06:28 user devstack@n-api.service[61612]: action_args: {'id': '381385a1-4c41-4479-b5cc-0222c9a7c2aa'} Apr 13 23:06:28 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa could not be found. Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa could not be found. Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa could not be found. Apr 13 23:06:28 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:06:28 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-6c965fd4-43cf-4bd5-a606-a9cb6d974d67 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Returning 404 to user: Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:06:28 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-6c965fd4-43cf-4bd5-a606-a9cb6d974d67 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa" status: 404 len: 111 microversion: 2.1 time: 0.038414 Apr 13 23:06:28 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 226/677] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:06:28 2023] GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:06:28 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:06:28 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:06:28 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-27130c39-a7af-477d-b444-3dd0cc1f9196 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '.version_select at 0x7f3d1db77b50>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:28 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-27130c39-a7af-477d-b444-3dd0cc1f9196 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-229071683" status: 202 len: 0 microversion: 2.1 time: 0.033158 Apr 13 23:06:28 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 229/678] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 23:06:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-229071683 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:06:35 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=22 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:06:35 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=34 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:06:35 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-ce2f5c25-089c-4904-b35c-5ba0a370c5a5 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:35 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-ce2f5c25-089c-4904-b35c-5ba0a370c5a5 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ce2f5c25-089c-4904-b35c-5ba0a370c5a5 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ce2f5c25-089c-4904-b35c-5ba0a370c5a5 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ce2f5c25-089c-4904-b35c-5ba0a370c5a5 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ce2f5c25-089c-4904-b35c-5ba0a370c5a5 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ce2f5c25-089c-4904-b35c-5ba0a370c5a5 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ce2f5c25-089c-4904-b35c-5ba0a370c5a5 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-ce2f5c25-089c-4904-b35c-5ba0a370c5a5 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] HTTP exception thrown: Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa could not be found. Apr 13 23:06:35 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-ce2f5c25-089c-4904-b35c-5ba0a370c5a5 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Request method failure captured: Apr 13 23:06:35 user devstack@n-api.service[61611]: request: DELETE /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa HTTP/1.1 Apr 13 23:06:35 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:06:35 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:06:35 user devstack@n-api.service[61611]: Connection: close Apr 13 23:06:35 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:06:35 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:06:35 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:06:35 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:06:35 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:06:35 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIfA8POs3fwPWdIWuED5bQRvy1sRPQ7bek3Y8_6hntA1E2vMW5JP4EbYd4WjeiKPkGYkQ0RbnlRV9PxsF2lw8jd7Bn8V3L0LhE5pzNTNHBFB9Xpzt7CoX84mD0x6WZrafVyEKTW01ClUMbS-tyN6oH8x8-VczX4_MbGFJ52_-5q5EIo Apr 13 23:06:35 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:06:35 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:06:35 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:06:35 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:06:35 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:06:35 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:06:35 user devstack@n-api.service[61611]: X-Project-Id: d0648ea953174a8cae6085ac24d92bb1 Apr 13 23:06:35 user devstack@n-api.service[61611]: X-Project-Name: tempest-AttachVolumeTestJSON-118072319 Apr 13 23:06:35 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:06:35 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:06:35 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d0648ea953174a8cae6085ac24d92bb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d0648ea953174a8cae6085ac24d92bb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d0648ea953174a8cae6085ac24d92bb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:06:35 user devstack@n-api.service[61611]: X-Tenant: tempest-AttachVolumeTestJSON-118072319 Apr 13 23:06:35 user devstack@n-api.service[61611]: X-Tenant-Id: d0648ea953174a8cae6085ac24d92bb1 Apr 13 23:06:35 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-AttachVolumeTestJSON-118072319 Apr 13 23:06:35 user devstack@n-api.service[61611]: X-User: tempest-AttachVolumeTestJSON-118072319-project-member Apr 13 23:06:35 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:06:35 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:06:35 user devstack@n-api.service[61611]: X-User-Id: 13b46af525dd45678b69207e93683ac4 Apr 13 23:06:35 user devstack@n-api.service[61611]: X-User-Name: tempest-AttachVolumeTestJSON-118072319-project-member Apr 13 23:06:35 user devstack@n-api.service[61611]: method: > Apr 13 23:06:35 user devstack@n-api.service[61611]: exception: Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa could not be found. Apr 13 23:06:35 user devstack@n-api.service[61611]: action_args: {'id': '381385a1-4c41-4479-b5cc-0222c9a7c2aa'} Apr 13 23:06:35 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa could not be found. Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa could not be found. Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa could not be found. Apr 13 23:06:35 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:06:35 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-ce2f5c25-089c-4904-b35c-5ba0a370c5a5 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Returning 404 to user: Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:06:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-ce2f5c25-089c-4904-b35c-5ba0a370c5a5 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa" status: 404 len: 111 microversion: 2.1 time: 0.042126 Apr 13 23:06:35 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 224/679] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:06:35 2023] DELETE /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:06:35 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-446b67ab-8c46-419a-a7e3-3ebeff50393c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:35 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-446b67ab-8c46-419a-a7e3-3ebeff50393c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-446b67ab-8c46-419a-a7e3-3ebeff50393c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-446b67ab-8c46-419a-a7e3-3ebeff50393c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-446b67ab-8c46-419a-a7e3-3ebeff50393c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-446b67ab-8c46-419a-a7e3-3ebeff50393c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-446b67ab-8c46-419a-a7e3-3ebeff50393c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-446b67ab-8c46-419a-a7e3-3ebeff50393c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:35 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-446b67ab-8c46-419a-a7e3-3ebeff50393c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] HTTP exception thrown: Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa could not be found. Apr 13 23:06:35 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-446b67ab-8c46-419a-a7e3-3ebeff50393c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Request method failure captured: Apr 13 23:06:35 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa HTTP/1.1 Apr 13 23:06:35 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:06:35 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:06:35 user devstack@n-api.service[61612]: Connection: close Apr 13 23:06:35 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:06:35 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:06:35 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:06:35 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:06:35 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:06:35 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIfA8POs3fwPWdIWuED5bQRvy1sRPQ7bek3Y8_6hntA1E2vMW5JP4EbYd4WjeiKPkGYkQ0RbnlRV9PxsF2lw8jd7Bn8V3L0LhE5pzNTNHBFB9Xpzt7CoX84mD0x6WZrafVyEKTW01ClUMbS-tyN6oH8x8-VczX4_MbGFJ52_-5q5EIo Apr 13 23:06:35 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:06:35 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:06:35 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:06:35 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:06:35 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:06:35 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:06:35 user devstack@n-api.service[61612]: X-Project-Id: d0648ea953174a8cae6085ac24d92bb1 Apr 13 23:06:35 user devstack@n-api.service[61612]: X-Project-Name: tempest-AttachVolumeTestJSON-118072319 Apr 13 23:06:35 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:06:35 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:06:35 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d0648ea953174a8cae6085ac24d92bb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d0648ea953174a8cae6085ac24d92bb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d0648ea953174a8cae6085ac24d92bb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:06:35 user devstack@n-api.service[61612]: X-Tenant: tempest-AttachVolumeTestJSON-118072319 Apr 13 23:06:35 user devstack@n-api.service[61612]: X-Tenant-Id: d0648ea953174a8cae6085ac24d92bb1 Apr 13 23:06:35 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-AttachVolumeTestJSON-118072319 Apr 13 23:06:35 user devstack@n-api.service[61612]: X-User: tempest-AttachVolumeTestJSON-118072319-project-member Apr 13 23:06:35 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:06:35 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:06:35 user devstack@n-api.service[61612]: X-User-Id: 13b46af525dd45678b69207e93683ac4 Apr 13 23:06:35 user devstack@n-api.service[61612]: X-User-Name: tempest-AttachVolumeTestJSON-118072319-project-member Apr 13 23:06:35 user devstack@n-api.service[61612]: method: > Apr 13 23:06:35 user devstack@n-api.service[61612]: exception: Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa could not be found. Apr 13 23:06:35 user devstack@n-api.service[61612]: action_args: {'id': '381385a1-4c41-4479-b5cc-0222c9a7c2aa'} Apr 13 23:06:35 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa could not be found. Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa could not be found. Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa could not be found. Apr 13 23:06:35 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:06:35 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-446b67ab-8c46-419a-a7e3-3ebeff50393c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Returning 404 to user: Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:06:35 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-446b67ab-8c46-419a-a7e3-3ebeff50393c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa" status: 404 len: 111 microversion: 2.1 time: 0.030495 Apr 13 23:06:35 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 227/680] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:06:35 2023] GET /compute/v2.1/servers/381385a1-4c41-4479-b5cc-0222c9a7c2aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:06:38 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:06:38 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-d04a8c13-1ba8-48f2-9111-afc4b4b69255 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:38 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-d04a8c13-1ba8-48f2-9111-afc4b4b69255 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d04a8c13-1ba8-48f2-9111-afc4b4b69255 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d04a8c13-1ba8-48f2-9111-afc4b4b69255 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d04a8c13-1ba8-48f2-9111-afc4b4b69255 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d04a8c13-1ba8-48f2-9111-afc4b4b69255 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d04a8c13-1ba8-48f2-9111-afc4b4b69255 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d04a8c13-1ba8-48f2-9111-afc4b4b69255 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:38 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-d04a8c13-1ba8-48f2-9111-afc4b4b69255 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] HTTP exception thrown: Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b could not be found. Apr 13 23:06:38 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-d04a8c13-1ba8-48f2-9111-afc4b4b69255 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Request method failure captured: Apr 13 23:06:38 user devstack@n-api.service[61613]: request: DELETE /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b HTTP/1.1 Apr 13 23:06:38 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:06:38 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:06:38 user devstack@n-api.service[61613]: Connection: close Apr 13 23:06:38 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:06:38 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:06:38 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:06:38 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:06:38 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:06:38 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIfA8POs3fwPWdIWuED5bQRvy1sRPQ7bek3Y8_6hntA1E2vMW5JP4EbYd4WjeiKPkGYkQ0RbnlRV9PxsF2lw8jd7Bn8V3L0LhE5pzNTNHBFB9Xpzt7CoX84mD0x6WZrafVyEKTW01ClUMbS-tyN6oH8x8-VczX4_MbGFJ52_-5q5EIo Apr 13 23:06:38 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:06:38 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:06:38 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:06:38 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:06:38 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:06:38 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:06:38 user devstack@n-api.service[61613]: X-Project-Id: d0648ea953174a8cae6085ac24d92bb1 Apr 13 23:06:38 user devstack@n-api.service[61613]: X-Project-Name: tempest-AttachVolumeTestJSON-118072319 Apr 13 23:06:38 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:06:38 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:06:38 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d0648ea953174a8cae6085ac24d92bb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d0648ea953174a8cae6085ac24d92bb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d0648ea953174a8cae6085ac24d92bb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:06:38 user devstack@n-api.service[61613]: X-Tenant: tempest-AttachVolumeTestJSON-118072319 Apr 13 23:06:38 user devstack@n-api.service[61613]: X-Tenant-Id: d0648ea953174a8cae6085ac24d92bb1 Apr 13 23:06:38 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-AttachVolumeTestJSON-118072319 Apr 13 23:06:38 user devstack@n-api.service[61613]: X-User: tempest-AttachVolumeTestJSON-118072319-project-member Apr 13 23:06:38 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:06:38 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:06:38 user devstack@n-api.service[61613]: X-User-Id: 13b46af525dd45678b69207e93683ac4 Apr 13 23:06:38 user devstack@n-api.service[61613]: X-User-Name: tempest-AttachVolumeTestJSON-118072319-project-member Apr 13 23:06:38 user devstack@n-api.service[61613]: method: > Apr 13 23:06:38 user devstack@n-api.service[61613]: exception: Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b could not be found. Apr 13 23:06:38 user devstack@n-api.service[61613]: action_args: {'id': '92e1fa88-8896-4198-af4d-56d44baf3b9b'} Apr 13 23:06:38 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b could not be found. Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b could not be found. Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b could not be found. Apr 13 23:06:38 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:06:38 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-d04a8c13-1ba8-48f2-9111-afc4b4b69255 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Returning 404 to user: Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:06:38 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-d04a8c13-1ba8-48f2-9111-afc4b4b69255 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b" status: 404 len: 111 microversion: 2.1 time: 0.037509 Apr 13 23:06:38 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 230/681] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:06:38 2023] DELETE /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:06:38 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d82dd769-4d33-4110-8aa3-f906270fcc99 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:38 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-d82dd769-4d33-4110-8aa3-f906270fcc99 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d82dd769-4d33-4110-8aa3-f906270fcc99 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d82dd769-4d33-4110-8aa3-f906270fcc99 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d82dd769-4d33-4110-8aa3-f906270fcc99 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d82dd769-4d33-4110-8aa3-f906270fcc99 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d82dd769-4d33-4110-8aa3-f906270fcc99 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d82dd769-4d33-4110-8aa3-f906270fcc99 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:38 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-d82dd769-4d33-4110-8aa3-f906270fcc99 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] HTTP exception thrown: Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b could not be found. Apr 13 23:06:38 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d82dd769-4d33-4110-8aa3-f906270fcc99 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Request method failure captured: Apr 13 23:06:38 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b HTTP/1.1 Apr 13 23:06:38 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:06:38 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:06:38 user devstack@n-api.service[61611]: Connection: close Apr 13 23:06:38 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:06:38 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:06:38 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:06:38 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:06:38 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:06:38 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIfA8POs3fwPWdIWuED5bQRvy1sRPQ7bek3Y8_6hntA1E2vMW5JP4EbYd4WjeiKPkGYkQ0RbnlRV9PxsF2lw8jd7Bn8V3L0LhE5pzNTNHBFB9Xpzt7CoX84mD0x6WZrafVyEKTW01ClUMbS-tyN6oH8x8-VczX4_MbGFJ52_-5q5EIo Apr 13 23:06:38 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:06:38 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:06:38 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:06:38 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:06:38 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:06:38 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:06:38 user devstack@n-api.service[61611]: X-Project-Id: d0648ea953174a8cae6085ac24d92bb1 Apr 13 23:06:38 user devstack@n-api.service[61611]: X-Project-Name: tempest-AttachVolumeTestJSON-118072319 Apr 13 23:06:38 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:06:38 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:06:38 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d0648ea953174a8cae6085ac24d92bb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d0648ea953174a8cae6085ac24d92bb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d0648ea953174a8cae6085ac24d92bb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:06:38 user devstack@n-api.service[61611]: X-Tenant: tempest-AttachVolumeTestJSON-118072319 Apr 13 23:06:38 user devstack@n-api.service[61611]: X-Tenant-Id: d0648ea953174a8cae6085ac24d92bb1 Apr 13 23:06:38 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-AttachVolumeTestJSON-118072319 Apr 13 23:06:38 user devstack@n-api.service[61611]: X-User: tempest-AttachVolumeTestJSON-118072319-project-member Apr 13 23:06:38 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:06:38 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:06:38 user devstack@n-api.service[61611]: X-User-Id: 13b46af525dd45678b69207e93683ac4 Apr 13 23:06:38 user devstack@n-api.service[61611]: X-User-Name: tempest-AttachVolumeTestJSON-118072319-project-member Apr 13 23:06:38 user devstack@n-api.service[61611]: method: > Apr 13 23:06:38 user devstack@n-api.service[61611]: exception: Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b could not be found. Apr 13 23:06:38 user devstack@n-api.service[61611]: action_args: {'id': '92e1fa88-8896-4198-af4d-56d44baf3b9b'} Apr 13 23:06:38 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b could not be found. Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b could not be found. Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b could not be found. Apr 13 23:06:38 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:06:38 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d82dd769-4d33-4110-8aa3-f906270fcc99 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Returning 404 to user: Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:06:38 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-d82dd769-4d33-4110-8aa3-f906270fcc99 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b" status: 404 len: 111 microversion: 2.1 time: 0.029317 Apr 13 23:06:38 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 225/682] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:06:38 2023] GET /compute/v2.1/servers/92e1fa88-8896-4198-af4d-56d44baf3b9b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:06:42 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-eb35f629-2193-4cfb-bb90-2ba511c6814a tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-770098155"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:06:42 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-eb35f629-2193-4cfb-bb90-2ba511c6814a tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-eb35f629-2193-4cfb-bb90-2ba511c6814a tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-eb35f629-2193-4cfb-bb90-2ba511c6814a tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-eb35f629-2193-4cfb-bb90-2ba511c6814a tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-eb35f629-2193-4cfb-bb90-2ba511c6814a tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-eb35f629-2193-4cfb-bb90-2ba511c6814a tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-eb35f629-2193-4cfb-bb90-2ba511c6814a tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:42 user devstack@n-api.service[61612]: INFO nova.network.security_group_api [None req-eb35f629-2193-4cfb-bb90-2ba511c6814a tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Removing security group 7607aa26-ea36-4297-bbc5-1e76c8a104d1 from port 95b6eed4-ff6e-493e-a912-d263def87a82 Apr 13 23:06:43 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-eb35f629-2193-4cfb-bb90-2ba511c6814a tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "POST /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/action" status: 202 len: 0 microversion: 2.1 time: 1.335934 Apr 13 23:06:43 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 228/683] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 23:06:42 2023] POST /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/action => generated 0 bytes in 1338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:06:43 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-091c59ca-1c01-489c-b5f7-49ec5ee1cf0b req-6be592cb-dc03-4e8a-b8be-76d312fcbc5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c7e35a-9a30-44ff-bb5f-74d122bf08d2", "tag": "95b6eed4-ff6e-493e-a912-d263def87a82"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:06:43 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-091c59ca-1c01-489c-b5f7-49ec5ee1cf0b req-6be592cb-dc03-4e8a-b8be-76d312fcbc5d service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:43 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-091c59ca-1c01-489c-b5f7-49ec5ee1cf0b req-6be592cb-dc03-4e8a-b8be-76d312fcbc5d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:43 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-091c59ca-1c01-489c-b5f7-49ec5ee1cf0b req-6be592cb-dc03-4e8a-b8be-76d312fcbc5d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:43 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-091c59ca-1c01-489c-b5f7-49ec5ee1cf0b req-6be592cb-dc03-4e8a-b8be-76d312fcbc5d service nova] Creating event network-changed:95b6eed4-ff6e-493e-a912-d263def87a82 for instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 on user Apr 13 23:06:43 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-091c59ca-1c01-489c-b5f7-49ec5ee1cf0b req-6be592cb-dc03-4e8a-b8be-76d312fcbc5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084529 Apr 13 23:06:43 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 231/684] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:06:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:06:44 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:44 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:44 user devstack@n-api.service[61611]: DEBUG nova.objects.instance [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lazy-loading 'services' on Instance uuid 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 {{(pid=61611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:06:44 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/os-volume_attachments/2ac485a1-6354-4559-bc5d-5a22d6dfc7aa" status: 202 len: 0 microversion: 2.1 time: 0.167723 Apr 13 23:06:44 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 226/685] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 23:06:44 2023] DELETE /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/os-volume_attachments/2ac485a1-6354-4559-bc5d-5a22d6dfc7aa => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:06:44 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-ccf74691-9dc6-4ef7-8612-dd3f6d4078a0 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:44 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-ccf74691-9dc6-4ef7-8612-dd3f6d4078a0 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ccf74691-9dc6-4ef7-8612-dd3f6d4078a0 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ccf74691-9dc6-4ef7-8612-dd3f6d4078a0 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ccf74691-9dc6-4ef7-8612-dd3f6d4078a0 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ccf74691-9dc6-4ef7-8612-dd3f6d4078a0 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ccf74691-9dc6-4ef7-8612-dd3f6d4078a0 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ccf74691-9dc6-4ef7-8612-dd3f6d4078a0 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:44 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-ccf74691-9dc6-4ef7-8612-dd3f6d4078a0 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057266 Apr 13 23:06:44 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 229/686] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:06:44 2023] GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:06:45 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-c9377807-1501-46ce-94cb-d3f64ee580a7 req-41b362a0-f123-4fa4-97e5-947947a9418c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c7e35a-9a30-44ff-bb5f-74d122bf08d2", "tag": "95b6eed4-ff6e-493e-a912-d263def87a82"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:06:45 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c9377807-1501-46ce-94cb-d3f64ee580a7 req-41b362a0-f123-4fa4-97e5-947947a9418c service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:45 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c9377807-1501-46ce-94cb-d3f64ee580a7 req-41b362a0-f123-4fa4-97e5-947947a9418c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:45 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c9377807-1501-46ce-94cb-d3f64ee580a7 req-41b362a0-f123-4fa4-97e5-947947a9418c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:45 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-c9377807-1501-46ce-94cb-d3f64ee580a7 req-41b362a0-f123-4fa4-97e5-947947a9418c service nova] Creating event network-changed:95b6eed4-ff6e-493e-a912-d263def87a82 for instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 on user Apr 13 23:06:45 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-c9377807-1501-46ce-94cb-d3f64ee580a7 req-41b362a0-f123-4fa4-97e5-947947a9418c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046715 Apr 13 23:06:45 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 232/687] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:06:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:06:46 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-07063b96-d356-466d-b89f-b55c63f67d6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:46 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-07063b96-d356-466d-b89f-b55c63f67d6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-07063b96-d356-466d-b89f-b55c63f67d6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-07063b96-d356-466d-b89f-b55c63f67d6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-07063b96-d356-466d-b89f-b55c63f67d6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-07063b96-d356-466d-b89f-b55c63f67d6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-07063b96-d356-466d-b89f-b55c63f67d6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-07063b96-d356-466d-b89f-b55c63f67d6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:46 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-07063b96-d356-466d-b89f-b55c63f67d6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] HTTP exception thrown: Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 could not be found. Apr 13 23:06:46 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-07063b96-d356-466d-b89f-b55c63f67d6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Request method failure captured: Apr 13 23:06:46 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/47dce1cc-c872-41f3-81af-acfc6ccabe18 HTTP/1.1 Apr 13 23:06:46 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:06:46 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:06:46 user devstack@n-api.service[61611]: Connection: close Apr 13 23:06:46 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:06:46 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:06:46 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:06:46 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:06:46 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:06:46 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIn1WpkCHTcQ3vsm6vuXvLMwBukWR3T78fUteB1g1zobAkavXEwqiMsjm9a7O1wQSAPbhSneJ4g36HRneth-jvcWNhT4bg4W3DOs07jcjQHnm6EdcnPlV6wX56fpXkxsD2Vss9a8TpT8oI4bKWdzWDXg8gRXoxb6iO_eerJkHkQeHrY Apr 13 23:06:46 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:06:46 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:06:46 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:06:46 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:06:46 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:06:46 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:06:46 user devstack@n-api.service[61611]: X-Project-Id: d8a3c684b0414336b2ca770eb1f3ab17 Apr 13 23:06:46 user devstack@n-api.service[61611]: X-Project-Name: tempest-ServersNegativeTestJSON-1433854176 Apr 13 23:06:46 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:06:46 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:06:46 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d8a3c684b0414336b2ca770eb1f3ab17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8a3c684b0414336b2ca770eb1f3ab17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8a3c684b0414336b2ca770eb1f3ab17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:06:46 user devstack@n-api.service[61611]: X-Tenant: tempest-ServersNegativeTestJSON-1433854176 Apr 13 23:06:46 user devstack@n-api.service[61611]: X-Tenant-Id: d8a3c684b0414336b2ca770eb1f3ab17 Apr 13 23:06:46 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1433854176 Apr 13 23:06:46 user devstack@n-api.service[61611]: X-User: tempest-ServersNegativeTestJSON-1433854176-project-member Apr 13 23:06:46 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:06:46 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:06:46 user devstack@n-api.service[61611]: X-User-Id: 71593deacbd74fea9fc2faf5a9b08877 Apr 13 23:06:46 user devstack@n-api.service[61611]: X-User-Name: tempest-ServersNegativeTestJSON-1433854176-project-member Apr 13 23:06:46 user devstack@n-api.service[61611]: method: > Apr 13 23:06:46 user devstack@n-api.service[61611]: exception: Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 could not be found. Apr 13 23:06:46 user devstack@n-api.service[61611]: action_args: {'id': '47dce1cc-c872-41f3-81af-acfc6ccabe18'} Apr 13 23:06:46 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 could not be found. Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 could not be found. Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 could not be found. Apr 13 23:06:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:06:46 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-07063b96-d356-466d-b89f-b55c63f67d6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Returning 404 to user: Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:06:46 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-07063b96-d356-466d-b89f-b55c63f67d6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47dce1cc-c872-41f3-81af-acfc6ccabe18" status: 404 len: 111 microversion: 2.1 time: 0.101658 Apr 13 23:06:46 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 227/688] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:06:46 2023] GET /compute/v2.1/servers/47dce1cc-c872-41f3-81af-acfc6ccabe18 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:06:46 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-3d481644-0150-4884-847b-b18cdba33fbf tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:46 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-3d481644-0150-4884-847b-b18cdba33fbf tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:46 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3d481644-0150-4884-847b-b18cdba33fbf tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:46 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3d481644-0150-4884-847b-b18cdba33fbf tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:46 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3d481644-0150-4884-847b-b18cdba33fbf tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:46 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3d481644-0150-4884-847b-b18cdba33fbf tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:46 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3d481644-0150-4884-847b-b18cdba33fbf tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:46 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3d481644-0150-4884-847b-b18cdba33fbf tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:46 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-3d481644-0150-4884-847b-b18cdba33fbf tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71593deacbd74fea9fc2faf5a9b08877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a3c684b0414336b2ca770eb1f3ab17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:06:46 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-3d481644-0150-4884-847b-b18cdba33fbf tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc473fb8-e574-4e49-b860-3ae0066cc9b8" status: 200 len: 1491 microversion: 2.1 time: 0.146607 Apr 13 23:06:46 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 230/689] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:06:46 2023] GET /compute/v2.1/servers/dc473fb8-e574-4e49-b860-3ae0066cc9b8 => generated 1491 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:06:51 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-049c5081-ab5d-463f-91ed-5edbb214c190 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:51 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-049c5081-ab5d-463f-91ed-5edbb214c190 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-049c5081-ab5d-463f-91ed-5edbb214c190 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-049c5081-ab5d-463f-91ed-5edbb214c190 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-049c5081-ab5d-463f-91ed-5edbb214c190 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-049c5081-ab5d-463f-91ed-5edbb214c190 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-049c5081-ab5d-463f-91ed-5edbb214c190 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-049c5081-ab5d-463f-91ed-5edbb214c190 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:51 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-049c5081-ab5d-463f-91ed-5edbb214c190 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] HTTP exception thrown: Instance 10290935-3f12-4e11-9495-f9c037e89875 could not be found. Apr 13 23:06:51 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-049c5081-ab5d-463f-91ed-5edbb214c190 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Request method failure captured: Apr 13 23:06:51 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875 HTTP/1.1 Apr 13 23:06:51 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:06:51 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:06:51 user devstack@n-api.service[61613]: Connection: close Apr 13 23:06:51 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:06:51 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:06:51 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:06:51 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:06:51 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:06:51 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIpOP3UEnmLOZvOJEDVPf2wk4flRRrpa9fiGH051zttsU5zVYeX_85ewp8gm_8bmK68luEnhVMWDi2XQo5r-cqj6u5bZoaHdEgX4Q1DHh44II3sUgV-Q7PD-1eLA4I1idCRNk2angrfS28g5URYd-rM0g6liwu4jHzbyL3bxkoPZ-so Apr 13 23:06:51 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:06:51 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:06:51 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:06:51 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:06:51 user devstack@n-api.service[61613]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 23:06:51 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:06:51 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:06:51 user devstack@n-api.service[61613]: X-Project-Id: b822a2f291ff497aaaf66c26ed6afc79 Apr 13 23:06:51 user devstack@n-api.service[61613]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-560099641 Apr 13 23:06:51 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:06:51 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:06:51 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b822a2f291ff497aaaf66c26ed6afc79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b822a2f291ff497aaaf66c26ed6afc79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b822a2f291ff497aaaf66c26ed6afc79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:06:51 user devstack@n-api.service[61613]: X-Tenant: tempest-TaggedBootDevicesTest_v242-560099641 Apr 13 23:06:51 user devstack@n-api.service[61613]: X-Tenant-Id: b822a2f291ff497aaaf66c26ed6afc79 Apr 13 23:06:51 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-560099641 Apr 13 23:06:51 user devstack@n-api.service[61613]: X-User: tempest-TaggedBootDevicesTest_v242-560099641-project-member Apr 13 23:06:51 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:06:51 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:06:51 user devstack@n-api.service[61613]: X-User-Id: 6fc4aba6767a4af9899ac437ab183df8 Apr 13 23:06:51 user devstack@n-api.service[61613]: X-User-Name: tempest-TaggedBootDevicesTest_v242-560099641-project-member Apr 13 23:06:51 user devstack@n-api.service[61613]: method: > Apr 13 23:06:51 user devstack@n-api.service[61613]: exception: Instance 10290935-3f12-4e11-9495-f9c037e89875 could not be found. Apr 13 23:06:51 user devstack@n-api.service[61613]: action_args: {'id': '10290935-3f12-4e11-9495-f9c037e89875'} Apr 13 23:06:51 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10290935-3f12-4e11-9495-f9c037e89875 could not be found. Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10290935-3f12-4e11-9495-f9c037e89875 could not be found. Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10290935-3f12-4e11-9495-f9c037e89875 could not be found. Apr 13 23:06:51 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:06:51 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-049c5081-ab5d-463f-91ed-5edbb214c190 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Returning 404 to user: Instance 10290935-3f12-4e11-9495-f9c037e89875 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:06:51 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-049c5081-ab5d-463f-91ed-5edbb214c190 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875" status: 404 len: 111 microversion: 2.42 time: 0.037966 Apr 13 23:06:51 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 233/690] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:06:51 2023] GET /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:06:51 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-3a77bf4b-c5e8-45a9-b39f-cabdcfd8ba80 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Calling method '.version_select at 0x7f3d1c3fecb0>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:51 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-3a77bf4b-c5e8-45a9-b39f-cabdcfd8ba80 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-810663675" status: 204 len: 0 microversion: 2.42 time: 0.041683 Apr 13 23:06:51 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 228/691] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 13 23:06:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-810663675 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 23:06:53 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1233543598"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:06:53 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:54 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5abd67f0-3d76-4da7-9c09-d2dec9c95ce6 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:54 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-5abd67f0-3d76-4da7-9c09-d2dec9c95ce6 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5abd67f0-3d76-4da7-9c09-d2dec9c95ce6 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5abd67f0-3d76-4da7-9c09-d2dec9c95ce6 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5abd67f0-3d76-4da7-9c09-d2dec9c95ce6 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5abd67f0-3d76-4da7-9c09-d2dec9c95ce6 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5abd67f0-3d76-4da7-9c09-d2dec9c95ce6 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5abd67f0-3d76-4da7-9c09-d2dec9c95ce6 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:54 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-5abd67f0-3d76-4da7-9c09-d2dec9c95ce6 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] HTTP exception thrown: Instance 10290935-3f12-4e11-9495-f9c037e89875 could not be found. Apr 13 23:06:54 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5abd67f0-3d76-4da7-9c09-d2dec9c95ce6 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Request method failure captured: Apr 13 23:06:54 user devstack@n-api.service[61613]: request: DELETE /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875 HTTP/1.1 Apr 13 23:06:54 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:06:54 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:06:54 user devstack@n-api.service[61613]: Connection: close Apr 13 23:06:54 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:06:54 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:06:54 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:06:54 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:06:54 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:06:54 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIpOP3UEnmLOZvOJEDVPf2wk4flRRrpa9fiGH051zttsU5zVYeX_85ewp8gm_8bmK68luEnhVMWDi2XQo5r-cqj6u5bZoaHdEgX4Q1DHh44II3sUgV-Q7PD-1eLA4I1idCRNk2angrfS28g5URYd-rM0g6liwu4jHzbyL3bxkoPZ-so Apr 13 23:06:54 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:06:54 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:06:54 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:06:54 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:06:54 user devstack@n-api.service[61613]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 23:06:54 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:06:54 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:06:54 user devstack@n-api.service[61613]: X-Project-Id: b822a2f291ff497aaaf66c26ed6afc79 Apr 13 23:06:54 user devstack@n-api.service[61613]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-560099641 Apr 13 23:06:54 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:06:54 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:06:54 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b822a2f291ff497aaaf66c26ed6afc79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b822a2f291ff497aaaf66c26ed6afc79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b822a2f291ff497aaaf66c26ed6afc79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:06:54 user devstack@n-api.service[61613]: X-Tenant: tempest-TaggedBootDevicesTest_v242-560099641 Apr 13 23:06:54 user devstack@n-api.service[61613]: X-Tenant-Id: b822a2f291ff497aaaf66c26ed6afc79 Apr 13 23:06:54 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-560099641 Apr 13 23:06:54 user devstack@n-api.service[61613]: X-User: tempest-TaggedBootDevicesTest_v242-560099641-project-member Apr 13 23:06:54 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:06:54 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:06:54 user devstack@n-api.service[61613]: X-User-Id: 6fc4aba6767a4af9899ac437ab183df8 Apr 13 23:06:54 user devstack@n-api.service[61613]: X-User-Name: tempest-TaggedBootDevicesTest_v242-560099641-project-member Apr 13 23:06:54 user devstack@n-api.service[61613]: method: > Apr 13 23:06:54 user devstack@n-api.service[61613]: exception: Instance 10290935-3f12-4e11-9495-f9c037e89875 could not be found. Apr 13 23:06:54 user devstack@n-api.service[61613]: action_args: {'id': '10290935-3f12-4e11-9495-f9c037e89875'} Apr 13 23:06:54 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10290935-3f12-4e11-9495-f9c037e89875 could not be found. Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10290935-3f12-4e11-9495-f9c037e89875 could not be found. Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10290935-3f12-4e11-9495-f9c037e89875 could not be found. Apr 13 23:06:54 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:06:54 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5abd67f0-3d76-4da7-9c09-d2dec9c95ce6 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Returning 404 to user: Instance 10290935-3f12-4e11-9495-f9c037e89875 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:06:54 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-5abd67f0-3d76-4da7-9c09-d2dec9c95ce6 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875" status: 404 len: 111 microversion: 2.42 time: 0.032724 Apr 13 23:06:54 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 234/692] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 23:06:54 2023] DELETE /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:06:54 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-62571a05-1f13-477a-b3ca-a6350d448e60 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:06:54 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-62571a05-1f13-477a-b3ca-a6350d448e60 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:06:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-62571a05-1f13-477a-b3ca-a6350d448e60 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-62571a05-1f13-477a-b3ca-a6350d448e60 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-62571a05-1f13-477a-b3ca-a6350d448e60 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-62571a05-1f13-477a-b3ca-a6350d448e60 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:06:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-62571a05-1f13-477a-b3ca-a6350d448e60 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:06:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-62571a05-1f13-477a-b3ca-a6350d448e60 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:06:54 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-62571a05-1f13-477a-b3ca-a6350d448e60 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] HTTP exception thrown: Instance 10290935-3f12-4e11-9495-f9c037e89875 could not be found. Apr 13 23:06:54 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-62571a05-1f13-477a-b3ca-a6350d448e60 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Request method failure captured: Apr 13 23:06:54 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875 HTTP/1.1 Apr 13 23:06:54 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:06:54 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:06:54 user devstack@n-api.service[61611]: Connection: close Apr 13 23:06:54 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:06:54 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:06:54 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:06:54 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:06:54 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:06:54 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIpOP3UEnmLOZvOJEDVPf2wk4flRRrpa9fiGH051zttsU5zVYeX_85ewp8gm_8bmK68luEnhVMWDi2XQo5r-cqj6u5bZoaHdEgX4Q1DHh44II3sUgV-Q7PD-1eLA4I1idCRNk2angrfS28g5URYd-rM0g6liwu4jHzbyL3bxkoPZ-so Apr 13 23:06:54 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:06:54 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:06:54 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:06:54 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:06:54 user devstack@n-api.service[61611]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 23:06:54 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:06:54 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:06:54 user devstack@n-api.service[61611]: X-Project-Id: b822a2f291ff497aaaf66c26ed6afc79 Apr 13 23:06:54 user devstack@n-api.service[61611]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-560099641 Apr 13 23:06:54 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:06:54 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:06:54 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b822a2f291ff497aaaf66c26ed6afc79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b822a2f291ff497aaaf66c26ed6afc79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b822a2f291ff497aaaf66c26ed6afc79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:06:54 user devstack@n-api.service[61611]: X-Tenant: tempest-TaggedBootDevicesTest_v242-560099641 Apr 13 23:06:54 user devstack@n-api.service[61611]: X-Tenant-Id: b822a2f291ff497aaaf66c26ed6afc79 Apr 13 23:06:54 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-560099641 Apr 13 23:06:54 user devstack@n-api.service[61611]: X-User: tempest-TaggedBootDevicesTest_v242-560099641-project-member Apr 13 23:06:54 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:06:54 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:06:54 user devstack@n-api.service[61611]: X-User-Id: 6fc4aba6767a4af9899ac437ab183df8 Apr 13 23:06:54 user devstack@n-api.service[61611]: X-User-Name: tempest-TaggedBootDevicesTest_v242-560099641-project-member Apr 13 23:06:54 user devstack@n-api.service[61611]: method: > Apr 13 23:06:54 user devstack@n-api.service[61611]: exception: Instance 10290935-3f12-4e11-9495-f9c037e89875 could not be found. Apr 13 23:06:54 user devstack@n-api.service[61611]: action_args: {'id': '10290935-3f12-4e11-9495-f9c037e89875'} Apr 13 23:06:54 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10290935-3f12-4e11-9495-f9c037e89875 could not be found. Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10290935-3f12-4e11-9495-f9c037e89875 could not be found. Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10290935-3f12-4e11-9495-f9c037e89875 could not be found. Apr 13 23:06:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:06:54 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-62571a05-1f13-477a-b3ca-a6350d448e60 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Returning 404 to user: Instance 10290935-3f12-4e11-9495-f9c037e89875 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:06:54 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-62571a05-1f13-477a-b3ca-a6350d448e60 tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875" status: 404 len: 111 microversion: 2.42 time: 0.038219 Apr 13 23:06:54 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 229/693] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:06:54 2023] GET /compute/v2.1/servers/10290935-3f12-4e11-9495-f9c037e89875 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 13 23:06:54 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/action" status: 202 len: 52 microversion: 2.87 time: 1.020582 Apr 13 23:06:54 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 231/694] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 23:06:53 2023] POST /compute/v2.1/servers/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/action => generated 52 bytes in 1022 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 13 23:07:01 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-7cd33c78-d563-4b9b-ba8a-93b89f6b79d3 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:01 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-7cd33c78-d563-4b9b-ba8a-93b89f6b79d3 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7cd33c78-d563-4b9b-ba8a-93b89f6b79d3 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7cd33c78-d563-4b9b-ba8a-93b89f6b79d3 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7cd33c78-d563-4b9b-ba8a-93b89f6b79d3 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7cd33c78-d563-4b9b-ba8a-93b89f6b79d3 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7cd33c78-d563-4b9b-ba8a-93b89f6b79d3 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7cd33c78-d563-4b9b-ba8a-93b89f6b79d3 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:01 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-7cd33c78-d563-4b9b-ba8a-93b89f6b79d3 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:07:01 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-7cd33c78-d563-4b9b-ba8a-93b89f6b79d3 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:07:01 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-7cd33c78-d563-4b9b-ba8a-93b89f6b79d3 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:07:01 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-7cd33c78-d563-4b9b-ba8a-93b89f6b79d3 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" status: 200 len: 1690 microversion: 2.87 time: 0.208617 Apr 13 23:07:01 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 235/695] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:07:01 2023] GET /compute/v2.1/servers/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 => generated 1690 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 13 23:07:05 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:05 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-109950942", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "networks": [{"uuid": "db154217-b933-4624-bf61-98baf1727c6c"}]}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:07:05 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] validate_networks() for [('db154217-b933-4624-bf61-98baf1727c6c', None, None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:07:06 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:07:06 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:07:06 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:07:06 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:07:06 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:07:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:06 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Getting quotas for project 12ecbdf826b849bf995787ada9d4a673. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:07:06 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Getting quotas for user 1114619485574b9499b5384a9529003f and project 12ecbdf826b849bf995787ada9d4a673. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:07:06 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:07:06 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:07:06 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.005294 Apr 13 23:07:06 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 230/696] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:07:05 2023] POST /compute/v2.1/servers => generated 378 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:07:06 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=12 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:06 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:06 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-ef9fffd4-0368-42a1-8573-f80d03839ff5 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:06 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-ef9fffd4-0368-42a1-8573-f80d03839ff5 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:06 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-a2517e42-edb8-4347-9f6c-b6d1cbe1dad3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:06 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-a2517e42-edb8-4347-9f6c-b6d1cbe1dad3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a2517e42-edb8-4347-9f6c-b6d1cbe1dad3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a2517e42-edb8-4347-9f6c-b6d1cbe1dad3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a2517e42-edb8-4347-9f6c-b6d1cbe1dad3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a2517e42-edb8-4347-9f6c-b6d1cbe1dad3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a2517e42-edb8-4347-9f6c-b6d1cbe1dad3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a2517e42-edb8-4347-9f6c-b6d1cbe1dad3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-a2517e42-edb8-4347-9f6c-b6d1cbe1dad3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] HTTP exception thrown: Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 could not be found. Apr 13 23:07:06 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-a2517e42-edb8-4347-9f6c-b6d1cbe1dad3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Request method failure captured: Apr 13 23:07:06 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889 HTTP/1.1 Apr 13 23:07:06 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:07:06 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:07:06 user devstack@n-api.service[61613]: Connection: close Apr 13 23:07:06 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:07:06 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:07:06 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:07:06 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:07:06 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:07:06 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIfFTd-GGuNLZhpg908qNRAUWwxNgAfeCUimfaNa0b2DAb_GHBW4t-lVsJou0tz2or0f6bqUrzjLpozKP8y8w6AYyySvjwkcbo4hPrDnlFVSF3sjpEAKCireroRzn4mK7Mj_j8ZmmwDUGWxo3vQ2pAQyz117nhwbP810jFnZYlkUbLs Apr 13 23:07:06 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:07:06 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:07:06 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:07:06 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:07:06 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:07:06 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:07:06 user devstack@n-api.service[61613]: X-Project-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:07:06 user devstack@n-api.service[61613]: X-Project-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:06 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:07:06 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:07:06 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:07:06 user devstack@n-api.service[61613]: X-Tenant: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:06 user devstack@n-api.service[61613]: X-Tenant-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:07:06 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:06 user devstack@n-api.service[61613]: X-User: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:07:06 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:07:06 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:07:06 user devstack@n-api.service[61613]: X-User-Id: 98594f3f6ccf4ffdbfd91bcf192d936e Apr 13 23:07:06 user devstack@n-api.service[61613]: X-User-Name: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:07:06 user devstack@n-api.service[61613]: method: > Apr 13 23:07:06 user devstack@n-api.service[61613]: exception: Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 could not be found. Apr 13 23:07:06 user devstack@n-api.service[61613]: action_args: {'id': '454fafc9-4b6f-40c3-80fa-d590fb946889'} Apr 13 23:07:06 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 could not be found. Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 could not be found. Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 could not be found. Apr 13 23:07:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:07:06 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-a2517e42-edb8-4347-9f6c-b6d1cbe1dad3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Returning 404 to user: Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:07:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-a2517e42-edb8-4347-9f6c-b6d1cbe1dad3 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889" status: 404 len: 111 microversion: 2.1 time: 0.035079 Apr 13 23:07:06 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 236/697] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:07:06 2023] GET /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:07:06 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-db8c8346-1b11-4b1c-8ac7-af208197dfa1 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '.version_select at 0x7f3d1c3fdcf0>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:06 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-ef9fffd4-0368-42a1-8573-f80d03839ff5 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114619485574b9499b5384a9529003f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ecbdf826b849bf995787ada9d4a673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:07:06 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-db8c8346-1b11-4b1c-8ac7-af208197dfa1 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-661625581" status: 202 len: 0 microversion: 2.1 time: 0.023747 Apr 13 23:07:06 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 231/698] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 23:07:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-661625581 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:07:06 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-ef9fffd4-0368-42a1-8573-f80d03839ff5 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] 10.0.0.210 "GET /compute/v2.1/servers/392704a5-705a-43d0-bab8-801c7ef5b514" status: 200 len: 1207 microversion: 2.1 time: 0.083276 Apr 13 23:07:06 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 232/699] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:07:06 2023] GET /compute/v2.1/servers/392704a5-705a-43d0-bab8-801c7ef5b514 => generated 1207 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:07:09 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-66f848bc-1472-4732-becb-124f6e3256b7 req-4675652c-3513-4ba3-b88e-9c26d4aee1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "392704a5-705a-43d0-bab8-801c7ef5b514", "tag": "e6adbdf3-3dac-401e-a86f-51f53230f579"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:07:09 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=17 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-66f848bc-1472-4732-becb-124f6e3256b7 req-4675652c-3513-4ba3-b88e-9c26d4aee1e4 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-66f848bc-1472-4732-becb-124f6e3256b7 req-4675652c-3513-4ba3-b88e-9c26d4aee1e4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-66f848bc-1472-4732-becb-124f6e3256b7 req-4675652c-3513-4ba3-b88e-9c26d4aee1e4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:09 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=19 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:09 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-66f848bc-1472-4732-becb-124f6e3256b7 req-4675652c-3513-4ba3-b88e-9c26d4aee1e4 service nova] Creating event network-changed:e6adbdf3-3dac-401e-a86f-51f53230f579 for instance 392704a5-705a-43d0-bab8-801c7ef5b514 on user Apr 13 23:07:09 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-66f848bc-1472-4732-becb-124f6e3256b7 req-4675652c-3513-4ba3-b88e-9c26d4aee1e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053339 Apr 13 23:07:09 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 237/700] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:07:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:07:10 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-cb4466d7-99b4-4bc5-b2d8-d6e2d722c068 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:10 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-cb4466d7-99b4-4bc5-b2d8-d6e2d722c068 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cb4466d7-99b4-4bc5-b2d8-d6e2d722c068 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cb4466d7-99b4-4bc5-b2d8-d6e2d722c068 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cb4466d7-99b4-4bc5-b2d8-d6e2d722c068 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cb4466d7-99b4-4bc5-b2d8-d6e2d722c068 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cb4466d7-99b4-4bc5-b2d8-d6e2d722c068 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cb4466d7-99b4-4bc5-b2d8-d6e2d722c068 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:10 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-cb4466d7-99b4-4bc5-b2d8-d6e2d722c068 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] HTTP exception thrown: Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 could not be found. Apr 13 23:07:10 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-cb4466d7-99b4-4bc5-b2d8-d6e2d722c068 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Request method failure captured: Apr 13 23:07:10 user devstack@n-api.service[61611]: request: DELETE /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889 HTTP/1.1 Apr 13 23:07:10 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:07:10 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:07:10 user devstack@n-api.service[61611]: Connection: close Apr 13 23:07:10 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:07:10 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:07:10 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:07:10 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:07:10 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:07:10 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIfFTd-GGuNLZhpg908qNRAUWwxNgAfeCUimfaNa0b2DAb_GHBW4t-lVsJou0tz2or0f6bqUrzjLpozKP8y8w6AYyySvjwkcbo4hPrDnlFVSF3sjpEAKCireroRzn4mK7Mj_j8ZmmwDUGWxo3vQ2pAQyz117nhwbP810jFnZYlkUbLs Apr 13 23:07:10 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:07:10 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:07:10 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:07:10 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:07:10 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:07:10 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:07:10 user devstack@n-api.service[61611]: X-Project-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:07:10 user devstack@n-api.service[61611]: X-Project-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:10 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:07:10 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:07:10 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:07:10 user devstack@n-api.service[61611]: X-Tenant: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:10 user devstack@n-api.service[61611]: X-Tenant-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:07:10 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:10 user devstack@n-api.service[61611]: X-User: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:07:10 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:07:10 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:07:10 user devstack@n-api.service[61611]: X-User-Id: 98594f3f6ccf4ffdbfd91bcf192d936e Apr 13 23:07:10 user devstack@n-api.service[61611]: X-User-Name: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:07:10 user devstack@n-api.service[61611]: method: > Apr 13 23:07:10 user devstack@n-api.service[61611]: exception: Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 could not be found. Apr 13 23:07:10 user devstack@n-api.service[61611]: action_args: {'id': '454fafc9-4b6f-40c3-80fa-d590fb946889'} Apr 13 23:07:10 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 could not be found. Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 could not be found. Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 could not be found. Apr 13 23:07:10 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:07:10 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-cb4466d7-99b4-4bc5-b2d8-d6e2d722c068 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Returning 404 to user: Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:07:10 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-cb4466d7-99b4-4bc5-b2d8-d6e2d722c068 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889" status: 404 len: 111 microversion: 2.1 time: 0.043537 Apr 13 23:07:10 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 232/701] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:07:10 2023] DELETE /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:07:10 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-9993abb0-78ff-4aed-8d69-77c65f41d77a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:10 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-9993abb0-78ff-4aed-8d69-77c65f41d77a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9993abb0-78ff-4aed-8d69-77c65f41d77a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9993abb0-78ff-4aed-8d69-77c65f41d77a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9993abb0-78ff-4aed-8d69-77c65f41d77a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9993abb0-78ff-4aed-8d69-77c65f41d77a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9993abb0-78ff-4aed-8d69-77c65f41d77a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9993abb0-78ff-4aed-8d69-77c65f41d77a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:10 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-9993abb0-78ff-4aed-8d69-77c65f41d77a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] HTTP exception thrown: Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 could not be found. Apr 13 23:07:10 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-9993abb0-78ff-4aed-8d69-77c65f41d77a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Request method failure captured: Apr 13 23:07:10 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889 HTTP/1.1 Apr 13 23:07:10 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:07:10 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:07:10 user devstack@n-api.service[61612]: Connection: close Apr 13 23:07:10 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:07:10 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:07:10 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:07:10 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:07:10 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:07:10 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIfFTd-GGuNLZhpg908qNRAUWwxNgAfeCUimfaNa0b2DAb_GHBW4t-lVsJou0tz2or0f6bqUrzjLpozKP8y8w6AYyySvjwkcbo4hPrDnlFVSF3sjpEAKCireroRzn4mK7Mj_j8ZmmwDUGWxo3vQ2pAQyz117nhwbP810jFnZYlkUbLs Apr 13 23:07:10 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:07:10 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:07:10 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:07:10 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:07:10 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:07:10 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:07:10 user devstack@n-api.service[61612]: X-Project-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:07:10 user devstack@n-api.service[61612]: X-Project-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:10 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:07:10 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:07:10 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:07:10 user devstack@n-api.service[61612]: X-Tenant: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:10 user devstack@n-api.service[61612]: X-Tenant-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:07:10 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:10 user devstack@n-api.service[61612]: X-User: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:07:10 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:07:10 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:07:10 user devstack@n-api.service[61612]: X-User-Id: 98594f3f6ccf4ffdbfd91bcf192d936e Apr 13 23:07:10 user devstack@n-api.service[61612]: X-User-Name: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:07:10 user devstack@n-api.service[61612]: method: > Apr 13 23:07:10 user devstack@n-api.service[61612]: exception: Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 could not be found. Apr 13 23:07:10 user devstack@n-api.service[61612]: action_args: {'id': '454fafc9-4b6f-40c3-80fa-d590fb946889'} Apr 13 23:07:10 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 could not be found. Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 could not be found. Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 could not be found. Apr 13 23:07:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:07:10 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-9993abb0-78ff-4aed-8d69-77c65f41d77a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Returning 404 to user: Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:07:10 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-9993abb0-78ff-4aed-8d69-77c65f41d77a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889" status: 404 len: 111 microversion: 2.1 time: 0.031467 Apr 13 23:07:10 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 233/702] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:07:10 2023] GET /compute/v2.1/servers/454fafc9-4b6f-40c3-80fa-d590fb946889 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:07:11 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-070b2140-0f6a-4cd1-96fa-090e8989280c req-594f7f28-811c-4b44-9da4-c01fa9049d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392704a5-705a-43d0-bab8-801c7ef5b514", "name": "network-vif-plugged", "status": "completed", "tag": "e6adbdf3-3dac-401e-a86f-51f53230f579"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:07:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-070b2140-0f6a-4cd1-96fa-090e8989280c req-594f7f28-811c-4b44-9da4-c01fa9049d9d service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-070b2140-0f6a-4cd1-96fa-090e8989280c req-594f7f28-811c-4b44-9da4-c01fa9049d9d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-070b2140-0f6a-4cd1-96fa-090e8989280c req-594f7f28-811c-4b44-9da4-c01fa9049d9d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:11 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-070b2140-0f6a-4cd1-96fa-090e8989280c req-594f7f28-811c-4b44-9da4-c01fa9049d9d service nova] Creating event network-vif-plugged:e6adbdf3-3dac-401e-a86f-51f53230f579 for instance 392704a5-705a-43d0-bab8-801c7ef5b514 on user Apr 13 23:07:11 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-070b2140-0f6a-4cd1-96fa-090e8989280c req-594f7f28-811c-4b44-9da4-c01fa9049d9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030045 Apr 13 23:07:11 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 238/703] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:07:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:07:13 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-32decb9d-8c62-498d-8430-01a317adac8b tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:13 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-32decb9d-8c62-498d-8430-01a317adac8b tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-32decb9d-8c62-498d-8430-01a317adac8b tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-32decb9d-8c62-498d-8430-01a317adac8b tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-32decb9d-8c62-498d-8430-01a317adac8b tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-32decb9d-8c62-498d-8430-01a317adac8b tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-32decb9d-8c62-498d-8430-01a317adac8b tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-32decb9d-8c62-498d-8430-01a317adac8b tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:13 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-32decb9d-8c62-498d-8430-01a317adac8b tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.106076 Apr 13 23:07:13 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 233/704] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 23:07:13 2023] GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195/os-interface => generated 282 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:07:13 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-191e58e5-a8e5-4660-9e69-7d80fb1033cb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:13 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-191e58e5-a8e5-4660-9e69-7d80fb1033cb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-191e58e5-a8e5-4660-9e69-7d80fb1033cb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-191e58e5-a8e5-4660-9e69-7d80fb1033cb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-191e58e5-a8e5-4660-9e69-7d80fb1033cb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-191e58e5-a8e5-4660-9e69-7d80fb1033cb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-191e58e5-a8e5-4660-9e69-7d80fb1033cb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-191e58e5-a8e5-4660-9e69-7d80fb1033cb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:13 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-191e58e5-a8e5-4660-9e69-7d80fb1033cb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] HTTP exception thrown: Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 could not be found. Apr 13 23:07:13 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-191e58e5-a8e5-4660-9e69-7d80fb1033cb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Request method failure captured: Apr 13 23:07:13 user devstack@n-api.service[61612]: request: DELETE /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91 HTTP/1.1 Apr 13 23:07:13 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:07:13 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:07:13 user devstack@n-api.service[61612]: Connection: close Apr 13 23:07:13 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:07:13 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:07:13 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:07:13 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:07:13 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIfFTd-GGuNLZhpg908qNRAUWwxNgAfeCUimfaNa0b2DAb_GHBW4t-lVsJou0tz2or0f6bqUrzjLpozKP8y8w6AYyySvjwkcbo4hPrDnlFVSF3sjpEAKCireroRzn4mK7Mj_j8ZmmwDUGWxo3vQ2pAQyz117nhwbP810jFnZYlkUbLs Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Project-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Project-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Tenant: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Tenant-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:13 user devstack@n-api.service[61612]: X-User: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:07:13 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:07:13 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:07:13 user devstack@n-api.service[61612]: X-User-Id: 98594f3f6ccf4ffdbfd91bcf192d936e Apr 13 23:07:13 user devstack@n-api.service[61612]: X-User-Name: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:07:13 user devstack@n-api.service[61612]: method: > Apr 13 23:07:13 user devstack@n-api.service[61612]: exception: Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 could not be found. Apr 13 23:07:13 user devstack@n-api.service[61612]: action_args: {'id': '4435b0c4-7292-4348-bcd9-a712a2df3e91'} Apr 13 23:07:13 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 could not be found. Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 could not be found. Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 could not be found. Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:07:13 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-191e58e5-a8e5-4660-9e69-7d80fb1033cb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Returning 404 to user: Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:07:13 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-191e58e5-a8e5-4660-9e69-7d80fb1033cb tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91" status: 404 len: 111 microversion: 2.1 time: 0.029204 Apr 13 23:07:13 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 234/705] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:07:13 2023] DELETE /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:07:13 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-46e0cf5c-93f2-4107-b55f-110ff7c31ac4 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:13 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-46e0cf5c-93f2-4107-b55f-110ff7c31ac4 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-46e0cf5c-93f2-4107-b55f-110ff7c31ac4 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-46e0cf5c-93f2-4107-b55f-110ff7c31ac4 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-46e0cf5c-93f2-4107-b55f-110ff7c31ac4 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-46e0cf5c-93f2-4107-b55f-110ff7c31ac4 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-46e0cf5c-93f2-4107-b55f-110ff7c31ac4 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-46e0cf5c-93f2-4107-b55f-110ff7c31ac4 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:13 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-46e0cf5c-93f2-4107-b55f-110ff7c31ac4 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] HTTP exception thrown: Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 could not be found. Apr 13 23:07:13 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-46e0cf5c-93f2-4107-b55f-110ff7c31ac4 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Request method failure captured: Apr 13 23:07:13 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91 HTTP/1.1 Apr 13 23:07:13 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:07:13 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:07:13 user devstack@n-api.service[61613]: Connection: close Apr 13 23:07:13 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:07:13 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:07:13 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:07:13 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:07:13 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:07:13 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIfFTd-GGuNLZhpg908qNRAUWwxNgAfeCUimfaNa0b2DAb_GHBW4t-lVsJou0tz2or0f6bqUrzjLpozKP8y8w6AYyySvjwkcbo4hPrDnlFVSF3sjpEAKCireroRzn4mK7Mj_j8ZmmwDUGWxo3vQ2pAQyz117nhwbP810jFnZYlkUbLs Apr 13 23:07:13 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:07:13 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:07:13 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:07:13 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:07:13 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:07:13 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:07:13 user devstack@n-api.service[61613]: X-Project-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:07:13 user devstack@n-api.service[61613]: X-Project-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:13 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:07:13 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:07:13 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:07:13 user devstack@n-api.service[61613]: X-Tenant: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:13 user devstack@n-api.service[61613]: X-Tenant-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:07:13 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:13 user devstack@n-api.service[61613]: X-User: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:07:13 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:07:13 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:07:13 user devstack@n-api.service[61613]: X-User-Id: 98594f3f6ccf4ffdbfd91bcf192d936e Apr 13 23:07:13 user devstack@n-api.service[61613]: X-User-Name: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:07:13 user devstack@n-api.service[61613]: method: > Apr 13 23:07:13 user devstack@n-api.service[61613]: exception: Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 could not be found. Apr 13 23:07:13 user devstack@n-api.service[61613]: action_args: {'id': '4435b0c4-7292-4348-bcd9-a712a2df3e91'} Apr 13 23:07:13 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 could not be found. Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 could not be found. Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 could not be found. Apr 13 23:07:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:07:13 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-46e0cf5c-93f2-4107-b55f-110ff7c31ac4 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Returning 404 to user: Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:07:13 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-46e0cf5c-93f2-4107-b55f-110ff7c31ac4 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91" status: 404 len: 111 microversion: 2.1 time: 0.036031 Apr 13 23:07:13 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 239/706] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:07:13 2023] GET /compute/v2.1/servers/4435b0c4-7292-4348-bcd9-a712a2df3e91 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:07:13 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-1487bbca-bc16-47be-80ce-0f7eea64df9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:13 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-1487bbca-bc16-47be-80ce-0f7eea64df9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1487bbca-bc16-47be-80ce-0f7eea64df9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1487bbca-bc16-47be-80ce-0f7eea64df9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1487bbca-bc16-47be-80ce-0f7eea64df9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1487bbca-bc16-47be-80ce-0f7eea64df9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1487bbca-bc16-47be-80ce-0f7eea64df9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1487bbca-bc16-47be-80ce-0f7eea64df9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:13 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-1487bbca-bc16-47be-80ce-0f7eea64df9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] HTTP exception thrown: Instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f could not be found. Apr 13 23:07:13 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-1487bbca-bc16-47be-80ce-0f7eea64df9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Request method failure captured: Apr 13 23:07:13 user devstack@n-api.service[61611]: request: DELETE /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f HTTP/1.1 Apr 13 23:07:13 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:07:13 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:07:13 user devstack@n-api.service[61611]: Connection: close Apr 13 23:07:13 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:07:13 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:07:13 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:07:13 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:07:13 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:07:13 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIfFTd-GGuNLZhpg908qNRAUWwxNgAfeCUimfaNa0b2DAb_GHBW4t-lVsJou0tz2or0f6bqUrzjLpozKP8y8w6AYyySvjwkcbo4hPrDnlFVSF3sjpEAKCireroRzn4mK7Mj_j8ZmmwDUGWxo3vQ2pAQyz117nhwbP810jFnZYlkUbLs Apr 13 23:07:13 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:07:13 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:07:13 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:07:13 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:07:13 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:07:13 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:07:13 user devstack@n-api.service[61611]: X-Project-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:07:13 user devstack@n-api.service[61611]: X-Project-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:13 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:07:13 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:07:13 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:07:13 user devstack@n-api.service[61611]: X-Tenant: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:13 user devstack@n-api.service[61611]: X-Tenant-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:07:13 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:13 user devstack@n-api.service[61611]: X-User: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:07:13 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:07:13 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:07:13 user devstack@n-api.service[61611]: X-User-Id: 98594f3f6ccf4ffdbfd91bcf192d936e Apr 13 23:07:13 user devstack@n-api.service[61611]: X-User-Name: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:07:13 user devstack@n-api.service[61611]: method: > Apr 13 23:07:13 user devstack@n-api.service[61611]: exception: Instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f could not be found. Apr 13 23:07:13 user devstack@n-api.service[61611]: action_args: {'id': '74b32176-d23e-41cb-80b2-5e8eede9ba7f'} Apr 13 23:07:13 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f could not be found. Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f could not be found. Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f could not be found. Apr 13 23:07:13 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:07:13 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-1487bbca-bc16-47be-80ce-0f7eea64df9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Returning 404 to user: Instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:07:13 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-1487bbca-bc16-47be-80ce-0f7eea64df9b tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f" status: 404 len: 111 microversion: 2.1 time: 0.053659 Apr 13 23:07:13 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 234/707] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:07:13 2023] DELETE /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:07:13 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-84ae61c3-eafa-440a-9862-731cefc9e458 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:13 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-84ae61c3-eafa-440a-9862-731cefc9e458 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-84ae61c3-eafa-440a-9862-731cefc9e458 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-84ae61c3-eafa-440a-9862-731cefc9e458 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-84ae61c3-eafa-440a-9862-731cefc9e458 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-84ae61c3-eafa-440a-9862-731cefc9e458 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-84ae61c3-eafa-440a-9862-731cefc9e458 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-84ae61c3-eafa-440a-9862-731cefc9e458 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:13 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-84ae61c3-eafa-440a-9862-731cefc9e458 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] HTTP exception thrown: Instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f could not be found. Apr 13 23:07:13 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-84ae61c3-eafa-440a-9862-731cefc9e458 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Request method failure captured: Apr 13 23:07:13 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f HTTP/1.1 Apr 13 23:07:13 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:07:13 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:07:13 user devstack@n-api.service[61612]: Connection: close Apr 13 23:07:13 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:07:13 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:07:13 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:07:13 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:07:13 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIfFTd-GGuNLZhpg908qNRAUWwxNgAfeCUimfaNa0b2DAb_GHBW4t-lVsJou0tz2or0f6bqUrzjLpozKP8y8w6AYyySvjwkcbo4hPrDnlFVSF3sjpEAKCireroRzn4mK7Mj_j8ZmmwDUGWxo3vQ2pAQyz117nhwbP810jFnZYlkUbLs Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Project-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Project-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Tenant: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Tenant-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:07:13 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:13 user devstack@n-api.service[61612]: X-User: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:07:13 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:07:13 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:07:13 user devstack@n-api.service[61612]: X-User-Id: 98594f3f6ccf4ffdbfd91bcf192d936e Apr 13 23:07:13 user devstack@n-api.service[61612]: X-User-Name: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:07:13 user devstack@n-api.service[61612]: method: > Apr 13 23:07:13 user devstack@n-api.service[61612]: exception: Instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f could not be found. Apr 13 23:07:13 user devstack@n-api.service[61612]: action_args: {'id': '74b32176-d23e-41cb-80b2-5e8eede9ba7f'} Apr 13 23:07:13 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f could not be found. Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f could not be found. Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f could not be found. Apr 13 23:07:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:07:13 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-84ae61c3-eafa-440a-9862-731cefc9e458 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Returning 404 to user: Instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:07:13 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-84ae61c3-eafa-440a-9862-731cefc9e458 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f" status: 404 len: 111 microversion: 2.1 time: 0.048626 Apr 13 23:07:13 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 235/708] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:07:13 2023] GET /compute/v2.1/servers/74b32176-d23e-41cb-80b2-5e8eede9ba7f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:07:13 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-4668b478-4045-4bc1-bf4b-5149c5d5d524 req-31ffb5c3-bfd3-4746-a1ec-c9710a474460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392704a5-705a-43d0-bab8-801c7ef5b514", "name": "network-vif-plugged", "status": "completed", "tag": "e6adbdf3-3dac-401e-a86f-51f53230f579"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:07:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4668b478-4045-4bc1-bf4b-5149c5d5d524 req-31ffb5c3-bfd3-4746-a1ec-c9710a474460 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4668b478-4045-4bc1-bf4b-5149c5d5d524 req-31ffb5c3-bfd3-4746-a1ec-c9710a474460 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4668b478-4045-4bc1-bf4b-5149c5d5d524 req-31ffb5c3-bfd3-4746-a1ec-c9710a474460 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:13 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-4668b478-4045-4bc1-bf4b-5149c5d5d524 req-31ffb5c3-bfd3-4746-a1ec-c9710a474460 service nova] Creating event network-vif-plugged:e6adbdf3-3dac-401e-a86f-51f53230f579 for instance 392704a5-705a-43d0-bab8-801c7ef5b514 on user Apr 13 23:07:14 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-4668b478-4045-4bc1-bf4b-5149c5d5d524 req-31ffb5c3-bfd3-4746-a1ec-c9710a474460 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050995 Apr 13 23:07:14 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 240/709] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:07:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:07:14 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:14 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:14 user devstack@n-api.service[61611]: DEBUG nova.objects.instance [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'services' on Instance uuid deb24b5e-f858-4068-88c5-3c7708c7e195 {{(pid=61611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:07:14 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195/os-volume_attachments/642f82bc-0cb0-4600-b66e-9d8ab2b0a083" status: 202 len: 0 microversion: 2.1 time: 0.186359 Apr 13 23:07:14 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 235/710] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 23:07:14 2023] DELETE /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195/os-volume_attachments/642f82bc-0cb0-4600-b66e-9d8ab2b0a083 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:07:14 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-4ba768f2-26da-4135-8ebf-10396fa4f7c8 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:14 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-4ba768f2-26da-4135-8ebf-10396fa4f7c8 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4ba768f2-26da-4135-8ebf-10396fa4f7c8 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4ba768f2-26da-4135-8ebf-10396fa4f7c8 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4ba768f2-26da-4135-8ebf-10396fa4f7c8 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4ba768f2-26da-4135-8ebf-10396fa4f7c8 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4ba768f2-26da-4135-8ebf-10396fa4f7c8 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4ba768f2-26da-4135-8ebf-10396fa4f7c8 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:14 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-4ba768f2-26da-4135-8ebf-10396fa4f7c8 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049738 Apr 13 23:07:14 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 236/711] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:07:14 2023] GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:07:15 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-98b1a1b9-772e-431b-a451-7292524f336e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:15 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-98b1a1b9-772e-431b-a451-7292524f336e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-98b1a1b9-772e-431b-a451-7292524f336e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-98b1a1b9-772e-431b-a451-7292524f336e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-98b1a1b9-772e-431b-a451-7292524f336e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-98b1a1b9-772e-431b-a451-7292524f336e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-98b1a1b9-772e-431b-a451-7292524f336e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-98b1a1b9-772e-431b-a451-7292524f336e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:15 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-98b1a1b9-772e-431b-a451-7292524f336e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:07:15 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-98b1a1b9-772e-431b-a451-7292524f336e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a83b839-7b5b-4004-94da-d196d18caf0f" status: 200 len: 1440 microversion: 2.1 time: 0.216462 Apr 13 23:07:15 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 241/712] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:07:15 2023] GET /compute/v2.1/servers/1a83b839-7b5b-4004-94da-d196d18caf0f => generated 1440 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:07:16 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}, {"name": "network-changed", "server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:07:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:16 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] Creating event network-changed:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:07:16 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] Creating event network-changed:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:07:16 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:16 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044082 Apr 13 23:07:16 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 236/713] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:07:16 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 23:07:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-c2c3f8c4-d553-4ed6-b467-71188b8d1298 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:17 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-c2c3f8c4-d553-4ed6-b467-71188b8d1298 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:17 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c2c3f8c4-d553-4ed6-b467-71188b8d1298 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c2c3f8c4-d553-4ed6-b467-71188b8d1298 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c2c3f8c4-d553-4ed6-b467-71188b8d1298 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c2c3f8c4-d553-4ed6-b467-71188b8d1298 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c2c3f8c4-d553-4ed6-b467-71188b8d1298 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c2c3f8c4-d553-4ed6-b467-71188b8d1298 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:17 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-c2c3f8c4-d553-4ed6-b467-71188b8d1298 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] HTTP exception thrown: Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 could not be found. Apr 13 23:07:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-c2c3f8c4-d553-4ed6-b467-71188b8d1298 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Request method failure captured: Apr 13 23:07:17 user devstack@n-api.service[61612]: request: DELETE /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63 HTTP/1.1 Apr 13 23:07:17 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:07:17 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:07:17 user devstack@n-api.service[61612]: Connection: close Apr 13 23:07:17 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:07:17 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:07:17 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:07:17 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:07:17 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:07:17 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIfFTd-GGuNLZhpg908qNRAUWwxNgAfeCUimfaNa0b2DAb_GHBW4t-lVsJou0tz2or0f6bqUrzjLpozKP8y8w6AYyySvjwkcbo4hPrDnlFVSF3sjpEAKCireroRzn4mK7Mj_j8ZmmwDUGWxo3vQ2pAQyz117nhwbP810jFnZYlkUbLs Apr 13 23:07:17 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:07:17 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:07:17 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:07:17 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:07:17 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:07:17 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:07:17 user devstack@n-api.service[61612]: X-Project-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:07:17 user devstack@n-api.service[61612]: X-Project-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:17 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:07:17 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:07:17 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:07:17 user devstack@n-api.service[61612]: X-Tenant: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:17 user devstack@n-api.service[61612]: X-Tenant-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:07:17 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:17 user devstack@n-api.service[61612]: X-User: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:07:17 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:07:17 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:07:17 user devstack@n-api.service[61612]: X-User-Id: 98594f3f6ccf4ffdbfd91bcf192d936e Apr 13 23:07:17 user devstack@n-api.service[61612]: X-User-Name: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:07:17 user devstack@n-api.service[61612]: method: > Apr 13 23:07:17 user devstack@n-api.service[61612]: exception: Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 could not be found. Apr 13 23:07:17 user devstack@n-api.service[61612]: action_args: {'id': '0e10dfa7-4997-44b0-b26d-421c7a2d8b63'} Apr 13 23:07:17 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 could not be found. Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 could not be found. Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 could not be found. Apr 13 23:07:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:07:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-c2c3f8c4-d553-4ed6-b467-71188b8d1298 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Returning 404 to user: Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:07:17 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-c2c3f8c4-d553-4ed6-b467-71188b8d1298 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63" status: 404 len: 111 microversion: 2.1 time: 0.036949 Apr 13 23:07:17 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 237/714] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:07:17 2023] DELETE /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 13 23:07:17 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8565a4e4-c467-41f9-aa03-f131b63adddc tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:17 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-8565a4e4-c467-41f9-aa03-f131b63adddc tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8565a4e4-c467-41f9-aa03-f131b63adddc tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8565a4e4-c467-41f9-aa03-f131b63adddc tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8565a4e4-c467-41f9-aa03-f131b63adddc tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8565a4e4-c467-41f9-aa03-f131b63adddc tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8565a4e4-c467-41f9-aa03-f131b63adddc tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8565a4e4-c467-41f9-aa03-f131b63adddc tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:17 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-8565a4e4-c467-41f9-aa03-f131b63adddc tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] HTTP exception thrown: Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 could not be found. Apr 13 23:07:17 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8565a4e4-c467-41f9-aa03-f131b63adddc tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Request method failure captured: Apr 13 23:07:17 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63 HTTP/1.1 Apr 13 23:07:17 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:07:17 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:07:17 user devstack@n-api.service[61613]: Connection: close Apr 13 23:07:17 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:07:17 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:07:17 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:07:17 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:07:17 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:07:17 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIfFTd-GGuNLZhpg908qNRAUWwxNgAfeCUimfaNa0b2DAb_GHBW4t-lVsJou0tz2or0f6bqUrzjLpozKP8y8w6AYyySvjwkcbo4hPrDnlFVSF3sjpEAKCireroRzn4mK7Mj_j8ZmmwDUGWxo3vQ2pAQyz117nhwbP810jFnZYlkUbLs Apr 13 23:07:17 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:07:17 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:07:17 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:07:17 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:07:17 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:07:17 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:07:17 user devstack@n-api.service[61613]: X-Project-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:07:17 user devstack@n-api.service[61613]: X-Project-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:17 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:07:17 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:07:17 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85ccac99656842aca44f9f1eb7aa167a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:07:17 user devstack@n-api.service[61613]: X-Tenant: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:17 user devstack@n-api.service[61613]: X-Tenant-Id: 85ccac99656842aca44f9f1eb7aa167a Apr 13 23:07:17 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-704876090 Apr 13 23:07:17 user devstack@n-api.service[61613]: X-User: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:07:17 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:07:17 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:07:17 user devstack@n-api.service[61613]: X-User-Id: 98594f3f6ccf4ffdbfd91bcf192d936e Apr 13 23:07:17 user devstack@n-api.service[61613]: X-User-Name: tempest-AttachVolumeNegativeTest-704876090-project-member Apr 13 23:07:17 user devstack@n-api.service[61613]: method: > Apr 13 23:07:17 user devstack@n-api.service[61613]: exception: Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 could not be found. Apr 13 23:07:17 user devstack@n-api.service[61613]: action_args: {'id': '0e10dfa7-4997-44b0-b26d-421c7a2d8b63'} Apr 13 23:07:17 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 could not be found. Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 could not be found. Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 could not be found. Apr 13 23:07:17 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:07:17 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8565a4e4-c467-41f9-aa03-f131b63adddc tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Returning 404 to user: Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:07:17 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-8565a4e4-c467-41f9-aa03-f131b63adddc tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63" status: 404 len: 111 microversion: 2.1 time: 0.042069 Apr 13 23:07:17 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 242/715] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:07:17 2023] GET /compute/v2.1/servers/0e10dfa7-4997-44b0-b26d-421c7a2d8b63 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:07:17 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-656b8674-4fd5-4d9a-b4db-2cc2c9925229 req-f10b3b22-7447-44db-9329-f7aefb0a7fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a83b839-7b5b-4004-94da-d196d18caf0f", "tag": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:07:17 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-656b8674-4fd5-4d9a-b4db-2cc2c9925229 req-f10b3b22-7447-44db-9329-f7aefb0a7fe7 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-656b8674-4fd5-4d9a-b4db-2cc2c9925229 req-f10b3b22-7447-44db-9329-f7aefb0a7fe7 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-656b8674-4fd5-4d9a-b4db-2cc2c9925229 req-f10b3b22-7447-44db-9329-f7aefb0a7fe7 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:17 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-656b8674-4fd5-4d9a-b4db-2cc2c9925229 req-f10b3b22-7447-44db-9329-f7aefb0a7fe7 service nova] Creating event network-changed:a88bc4ee-b024-4d26-9e56-e60daf6ef5fa for instance 1a83b839-7b5b-4004-94da-d196d18caf0f on user Apr 13 23:07:17 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-656b8674-4fd5-4d9a-b4db-2cc2c9925229 req-f10b3b22-7447-44db-9329-f7aefb0a7fe7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054545 Apr 13 23:07:17 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 237/716] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:07:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:07:21 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-57351a6c-b8b8-4943-b44f-eddde692fe01 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Action: 'create', calling method: .version_select at 0x7f3d1dc489d0>, body: {"keypair": {"name": "tempest-keypair-1382560979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA=="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:07:21 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-57351a6c-b8b8-4943-b44f-eddde692fe01 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting quotas for project 68330047a5fd4e4397cf5edca18c5b51. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:07:21 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-57351a6c-b8b8-4943-b44f-eddde692fe01 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting quotas for user 59b2c11a23384f678a086de89139497d and project 68330047a5fd4e4397cf5edca18c5b51. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:07:21 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-57351a6c-b8b8-4943-b44f-eddde692fe01 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.161634 Apr 13 23:07:21 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 238/717] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 23:07:21 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:07:23 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1074557247", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "85b04a3c-80c1-4d43-9e13-6f8de7286808"}], "security_groups": [{"name": "tempest-securitygroup--687542213"}], "key_name": "tempest-keypair-1382560979", "user_data": "}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:07:23 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] validate_networks() for [('85b04a3c-80c1-4d43-9e13-6f8de7286808', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:07:23 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:07:23 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:07:23 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:07:23 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:07:23 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:07:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:23 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting quotas for project 68330047a5fd4e4397cf5edca18c5b51. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:07:23 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting quotas for user 59b2c11a23384f678a086de89139497d and project 68330047a5fd4e4397cf5edca18c5b51. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:07:23 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:07:23 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:07:23 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.700186 Apr 13 23:07:23 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 243/718] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:07:23 2023] POST /compute/v2.1/servers => generated 406 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:07:23 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b438e7a3-f842-4107-a8ce-7015f19cf956 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:23 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-b438e7a3-f842-4107-a8ce-7015f19cf956 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:23 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-b438e7a3-f842-4107-a8ce-7015f19cf956 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:07:23 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-b438e7a3-f842-4107-a8ce-7015f19cf956 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1233 microversion: 2.1 time: 0.076414 Apr 13 23:07:23 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 238/719] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:07:23 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1233 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:07:24 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-803529970", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-408481084", "security_groups": [{"name": "tempest-secgroup-smoke-320997561"}], "block_device_mapping_v2": [{"uuid": "cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aadb940e-808f-4d62-87fe-765d072b7c2f"}]}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:07:25 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] validate_networks() for [('aadb940e-808f-4d62-87fe-765d072b7c2f', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:07:25 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:07:25 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:07:25 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:07:25 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:07:25 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:07:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:25 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting quotas for project d872848d5dc1471996e2f33bbbdebbd9. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:07:25 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting quotas for user b289294050af4c41aeef8401832487a1 and project d872848d5dc1471996e2f33bbbdebbd9. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:07:25 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:07:25 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf',volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:07:25 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.773647 Apr 13 23:07:25 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 239/720] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:07:24 2023] POST /compute/v2.1/servers => generated 403 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:07:25 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-f1c32629-eb1e-477d-8fb0-67fee9cc7585 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:25 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-f1c32629-eb1e-477d-8fb0-67fee9cc7585 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:25 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-f1c32629-eb1e-477d-8fb0-67fee9cc7585 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:07:25 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-f1c32629-eb1e-477d-8fb0-67fee9cc7585 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a9f5f1f-cc46-4c3c-834d-daa002031ee3" status: 200 len: 1088 microversion: 2.1 time: 0.091857 Apr 13 23:07:25 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 244/721] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:07:25 2023] GET /compute/v2.1/servers/1a9f5f1f-cc46-4c3c-834d-daa002031ee3 => generated 1088 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:07:26 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-4958014d-9f3b-4595-b2a6-cf443bdbdd1f req-579461e3-5d1d-4c0d-b8f4-d6b1c94d0040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d", "tag": "09cc0c17-bd49-4207-9de4-89178a1e681e"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:07:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-4958014d-9f3b-4595-b2a6-cf443bdbdd1f req-579461e3-5d1d-4c0d-b8f4-d6b1c94d0040 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-4958014d-9f3b-4595-b2a6-cf443bdbdd1f req-579461e3-5d1d-4c0d-b8f4-d6b1c94d0040 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-4958014d-9f3b-4595-b2a6-cf443bdbdd1f req-579461e3-5d1d-4c0d-b8f4-d6b1c94d0040 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-4958014d-9f3b-4595-b2a6-cf443bdbdd1f req-579461e3-5d1d-4c0d-b8f4-d6b1c94d0040 service nova] Creating event network-changed:09cc0c17-bd49-4207-9de4-89178a1e681e for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d on user Apr 13 23:07:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-4958014d-9f3b-4595-b2a6-cf443bdbdd1f req-579461e3-5d1d-4c0d-b8f4-d6b1c94d0040 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035971 Apr 13 23:07:26 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 239/722] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:07:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:07:28 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-60872089-a180-4cf8-8e4a-6835a6467965 req-8135099d-2cf4-4acd-bbfb-a4a7e3855b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a9f5f1f-cc46-4c3c-834d-daa002031ee3", "tag": "e1ea4927-3d26-47cf-8db8-daa6fe358335"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:07:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-60872089-a180-4cf8-8e4a-6835a6467965 req-8135099d-2cf4-4acd-bbfb-a4a7e3855b30 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-60872089-a180-4cf8-8e4a-6835a6467965 req-8135099d-2cf4-4acd-bbfb-a4a7e3855b30 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-60872089-a180-4cf8-8e4a-6835a6467965 req-8135099d-2cf4-4acd-bbfb-a4a7e3855b30 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:28 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-60872089-a180-4cf8-8e4a-6835a6467965 req-8135099d-2cf4-4acd-bbfb-a4a7e3855b30 service nova] Creating event network-changed:e1ea4927-3d26-47cf-8db8-daa6fe358335 for instance 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 on user Apr 13 23:07:28 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-60872089-a180-4cf8-8e4a-6835a6467965 req-8135099d-2cf4-4acd-bbfb-a4a7e3855b30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031561 Apr 13 23:07:28 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 240/723] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:07:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:07:29 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-f331a891-3db2-4170-b259-3b6fbadd79cd req-190cb870-5189-4449-8b6a-cdab28eec367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d", "name": "network-vif-plugged", "status": "completed", "tag": "09cc0c17-bd49-4207-9de4-89178a1e681e"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:07:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-f331a891-3db2-4170-b259-3b6fbadd79cd req-190cb870-5189-4449-8b6a-cdab28eec367 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-f331a891-3db2-4170-b259-3b6fbadd79cd req-190cb870-5189-4449-8b6a-cdab28eec367 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-f331a891-3db2-4170-b259-3b6fbadd79cd req-190cb870-5189-4449-8b6a-cdab28eec367 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:29 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-f331a891-3db2-4170-b259-3b6fbadd79cd req-190cb870-5189-4449-8b6a-cdab28eec367 service nova] Creating event network-vif-plugged:09cc0c17-bd49-4207-9de4-89178a1e681e for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d on user Apr 13 23:07:29 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-f331a891-3db2-4170-b259-3b6fbadd79cd req-190cb870-5189-4449-8b6a-cdab28eec367 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050654 Apr 13 23:07:29 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 245/724] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:07:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:07:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-bb479c92-3f6c-4fc1-9ae5-69705012b423 req-334d1637-bb2e-45f7-83b2-eee16d6363d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d", "name": "network-vif-plugged", "status": "completed", "tag": "09cc0c17-bd49-4207-9de4-89178a1e681e"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:07:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-bb479c92-3f6c-4fc1-9ae5-69705012b423 req-334d1637-bb2e-45f7-83b2-eee16d6363d1 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-bb479c92-3f6c-4fc1-9ae5-69705012b423 req-334d1637-bb2e-45f7-83b2-eee16d6363d1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-bb479c92-3f6c-4fc1-9ae5-69705012b423 req-334d1637-bb2e-45f7-83b2-eee16d6363d1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:31 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-bb479c92-3f6c-4fc1-9ae5-69705012b423 req-334d1637-bb2e-45f7-83b2-eee16d6363d1 service nova] Creating event network-vif-plugged:09cc0c17-bd49-4207-9de4-89178a1e681e for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d on user Apr 13 23:07:31 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-bb479c92-3f6c-4fc1-9ae5-69705012b423 req-334d1637-bb2e-45f7-83b2-eee16d6363d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029989 Apr 13 23:07:31 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 240/725] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:07:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:07:34 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-05a6846e-d0a8-483d-a47c-924e892fd0de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:34 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-05a6846e-d0a8-483d-a47c-924e892fd0de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-05a6846e-d0a8-483d-a47c-924e892fd0de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-05a6846e-d0a8-483d-a47c-924e892fd0de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-05a6846e-d0a8-483d-a47c-924e892fd0de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-05a6846e-d0a8-483d-a47c-924e892fd0de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-05a6846e-d0a8-483d-a47c-924e892fd0de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-05a6846e-d0a8-483d-a47c-924e892fd0de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:34 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-05a6846e-d0a8-483d-a47c-924e892fd0de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.258328 Apr 13 23:07:34 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 241/726] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:07:34 2023] GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/os-volume_attachments => generated 25 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 23:07:34 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:34 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e53153ab-a694-4fee-9b25-77e843edb8de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:34 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-e53153ab-a694-4fee-9b25-77e843edb8de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e53153ab-a694-4fee-9b25-77e843edb8de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e53153ab-a694-4fee-9b25-77e843edb8de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e53153ab-a694-4fee-9b25-77e843edb8de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e53153ab-a694-4fee-9b25-77e843edb8de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e53153ab-a694-4fee-9b25-77e843edb8de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e53153ab-a694-4fee-9b25-77e843edb8de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:34 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-e53153ab-a694-4fee-9b25-77e843edb8de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] HTTP exception thrown: Instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 is not attached to volume 2ac485a1-6354-4559-bc5d-5a22d6dfc7aa Apr 13 23:07:34 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e53153ab-a694-4fee-9b25-77e843edb8de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Request method failure captured: Apr 13 23:07:34 user devstack@n-api.service[61613]: request: DELETE /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/os-volume_attachments/2ac485a1-6354-4559-bc5d-5a22d6dfc7aa HTTP/1.1 Apr 13 23:07:34 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:07:34 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:07:34 user devstack@n-api.service[61613]: Connection: close Apr 13 23:07:34 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:07:34 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:07:34 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:07:34 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:07:34 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:07:34 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIiqmOc_jLwesAQk99mPpAwX4yPkvI4gxc0CX79zo2U49YpOkE1P1Vgrgx0AIOV4uSWhOhTpAt3ClJ1sc2omO3e6uzmuNuDjNfjdF-ljuOMYFVYPTVI7GUSixFeXrIvRxQWRt5GRaZsPC5aFcdH4Eq-k5brL5De7wLsJ-zubuNON-es Apr 13 23:07:34 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:07:34 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:07:34 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:07:34 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:07:34 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:07:34 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:07:34 user devstack@n-api.service[61613]: X-Project-Id: cf532d1c87a34b8cbde0f162688f7cdb Apr 13 23:07:34 user devstack@n-api.service[61613]: X-Project-Name: tempest-TestMinimumBasicScenario-146514025 Apr 13 23:07:34 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:07:34 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:07:34 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf532d1c87a34b8cbde0f162688f7cdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf532d1c87a34b8cbde0f162688f7cdb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf532d1c87a34b8cbde0f162688f7cdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:07:34 user devstack@n-api.service[61613]: X-Tenant: tempest-TestMinimumBasicScenario-146514025 Apr 13 23:07:34 user devstack@n-api.service[61613]: X-Tenant-Id: cf532d1c87a34b8cbde0f162688f7cdb Apr 13 23:07:34 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-TestMinimumBasicScenario-146514025 Apr 13 23:07:34 user devstack@n-api.service[61613]: X-User: tempest-TestMinimumBasicScenario-146514025-project-member Apr 13 23:07:34 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:07:34 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:07:34 user devstack@n-api.service[61613]: X-User-Id: fad76e3a6e154feaa62d95f6e7d1ce1c Apr 13 23:07:34 user devstack@n-api.service[61613]: X-User-Name: tempest-TestMinimumBasicScenario-146514025-project-member Apr 13 23:07:34 user devstack@n-api.service[61613]: method: > Apr 13 23:07:34 user devstack@n-api.service[61613]: exception: Instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 is not attached to volume 2ac485a1-6354-4559-bc5d-5a22d6dfc7aa Apr 13 23:07:34 user devstack@n-api.service[61613]: action_args: {'server_id': '70c7e35a-9a30-44ff-bb5f-74d122bf08d2', 'id': '2ac485a1-6354-4559-bc5d-5a22d6dfc7aa'} Apr 13 23:07:34 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2ac485a1-6354-4559-bc5d-5a22d6dfc7aa. Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 is not attached to volume 2ac485a1-6354-4559-bc5d-5a22d6dfc7aa Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 is not attached to volume 2ac485a1-6354-4559-bc5d-5a22d6dfc7aa Apr 13 23:07:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:07:34 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e53153ab-a694-4fee-9b25-77e843edb8de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Returning 404 to user: Instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 is not attached to volume 2ac485a1-6354-4559-bc5d-5a22d6dfc7aa {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:07:34 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-e53153ab-a694-4fee-9b25-77e843edb8de tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/os-volume_attachments/2ac485a1-6354-4559-bc5d-5a22d6dfc7aa" status: 404 len: 154 microversion: 2.1 time: 0.119025 Apr 13 23:07:34 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 246/727] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 23:07:34 2023] DELETE /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/os-volume_attachments/2ac485a1-6354-4559-bc5d-5a22d6dfc7aa => generated 154 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 13 23:07:35 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:35 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-0b605300-e46e-4ffd-98cd-bdf7696daf83 req-d13bcf88-c830-4b0f-9d11-5563a6c15dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a9f5f1f-cc46-4c3c-834d-daa002031ee3", "name": "network-vif-plugged", "status": "completed", "tag": "e1ea4927-3d26-47cf-8db8-daa6fe358335"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:07:35 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0b605300-e46e-4ffd-98cd-bdf7696daf83 req-d13bcf88-c830-4b0f-9d11-5563a6c15dd3 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0b605300-e46e-4ffd-98cd-bdf7696daf83 req-d13bcf88-c830-4b0f-9d11-5563a6c15dd3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0b605300-e46e-4ffd-98cd-bdf7696daf83 req-d13bcf88-c830-4b0f-9d11-5563a6c15dd3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:35 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-0b605300-e46e-4ffd-98cd-bdf7696daf83 req-d13bcf88-c830-4b0f-9d11-5563a6c15dd3 service nova] Creating event network-vif-plugged:e1ea4927-3d26-47cf-8db8-daa6fe358335 for instance 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 on user Apr 13 23:07:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-0b605300-e46e-4ffd-98cd-bdf7696daf83 req-d13bcf88-c830-4b0f-9d11-5563a6c15dd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050020 Apr 13 23:07:35 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 241/728] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:07:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:07:37 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-d461d011-6519-457c-8f8a-114fc5186d5b req-af7db49a-03ab-4b0e-a409-68de2cb9f24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a9f5f1f-cc46-4c3c-834d-daa002031ee3", "name": "network-vif-plugged", "status": "completed", "tag": "e1ea4927-3d26-47cf-8db8-daa6fe358335"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:07:37 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:37 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=10 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:37 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d461d011-6519-457c-8f8a-114fc5186d5b req-af7db49a-03ab-4b0e-a409-68de2cb9f24a service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d461d011-6519-457c-8f8a-114fc5186d5b req-af7db49a-03ab-4b0e-a409-68de2cb9f24a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d461d011-6519-457c-8f8a-114fc5186d5b req-af7db49a-03ab-4b0e-a409-68de2cb9f24a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:37 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=25 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:37 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-d461d011-6519-457c-8f8a-114fc5186d5b req-af7db49a-03ab-4b0e-a409-68de2cb9f24a service nova] Creating event network-vif-plugged:e1ea4927-3d26-47cf-8db8-daa6fe358335 for instance 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 on user Apr 13 23:07:37 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-d461d011-6519-457c-8f8a-114fc5186d5b req-af7db49a-03ab-4b0e-a409-68de2cb9f24a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058273 Apr 13 23:07:37 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 242/729] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:07:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:07:38 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:38 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:38 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=8 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:38 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:07:38 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2" status: 204 len: 0 microversion: 2.1 time: 0.135117 Apr 13 23:07:38 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 247/730] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:07:38 2023] DELETE /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:07:38 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-1f2a5b2e-b094-4c16-b78f-46d7c970234b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:38 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-1f2a5b2e-b094-4c16-b78f-46d7c970234b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1f2a5b2e-b094-4c16-b78f-46d7c970234b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1f2a5b2e-b094-4c16-b78f-46d7c970234b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1f2a5b2e-b094-4c16-b78f-46d7c970234b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1f2a5b2e-b094-4c16-b78f-46d7c970234b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1f2a5b2e-b094-4c16-b78f-46d7c970234b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1f2a5b2e-b094-4c16-b78f-46d7c970234b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:38 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-1f2a5b2e-b094-4c16-b78f-46d7c970234b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:07:38 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-1f2a5b2e-b094-4c16-b78f-46d7c970234b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2" status: 200 len: 1542 microversion: 2.1 time: 0.269483 Apr 13 23:07:38 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 242/731] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:07:38 2023] GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2 => generated 1542 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:07:39 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-69d30d90-0641-4870-b6f9-89aa96c3736b req-19e3469a-b3de-4807-b913-dbf1bf106200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c7e35a-9a30-44ff-bb5f-74d122bf08d2", "name": "network-vif-unplugged", "status": "completed", "tag": "95b6eed4-ff6e-493e-a912-d263def87a82"}, {"server_uuid": "70c7e35a-9a30-44ff-bb5f-74d122bf08d2", "name": "network-vif-plugged", "status": "completed", "tag": "95b6eed4-ff6e-493e-a912-d263def87a82"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:07:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-69d30d90-0641-4870-b6f9-89aa96c3736b req-19e3469a-b3de-4807-b913-dbf1bf106200 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-69d30d90-0641-4870-b6f9-89aa96c3736b req-19e3469a-b3de-4807-b913-dbf1bf106200 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-69d30d90-0641-4870-b6f9-89aa96c3736b req-19e3469a-b3de-4807-b913-dbf1bf106200 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:39 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-69d30d90-0641-4870-b6f9-89aa96c3736b req-19e3469a-b3de-4807-b913-dbf1bf106200 service nova] Creating event network-vif-unplugged:95b6eed4-ff6e-493e-a912-d263def87a82 for instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 on user Apr 13 23:07:39 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-69d30d90-0641-4870-b6f9-89aa96c3736b req-19e3469a-b3de-4807-b913-dbf1bf106200 service nova] Creating event network-vif-plugged:95b6eed4-ff6e-493e-a912-d263def87a82 for instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 on user Apr 13 23:07:39 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-69d30d90-0641-4870-b6f9-89aa96c3736b req-19e3469a-b3de-4807-b913-dbf1bf106200 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.034486 Apr 13 23:07:39 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 243/732] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:07:39 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:07:39 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-d5ddc879-5f56-48de-bedd-dccdae90563b req-89a85f2e-2538-47d4-97b7-09da8cbf66cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c7e35a-9a30-44ff-bb5f-74d122bf08d2", "name": "network-vif-deleted", "tag": "95b6eed4-ff6e-493e-a912-d263def87a82"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:07:39 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d5ddc879-5f56-48de-bedd-dccdae90563b req-89a85f2e-2538-47d4-97b7-09da8cbf66cf service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d5ddc879-5f56-48de-bedd-dccdae90563b req-89a85f2e-2538-47d4-97b7-09da8cbf66cf service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d5ddc879-5f56-48de-bedd-dccdae90563b req-89a85f2e-2538-47d4-97b7-09da8cbf66cf service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:39 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:39 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-d5ddc879-5f56-48de-bedd-dccdae90563b req-89a85f2e-2538-47d4-97b7-09da8cbf66cf service nova] Creating event network-vif-deleted:95b6eed4-ff6e-493e-a912-d263def87a82 for instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 on user Apr 13 23:07:39 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-d5ddc879-5f56-48de-bedd-dccdae90563b req-89a85f2e-2538-47d4-97b7-09da8cbf66cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058354 Apr 13 23:07:39 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 248/733] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:07:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:07:49 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-bce5d5f6-083b-4380-b83b-eb68b0cdae83 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-757478972", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "64e45562-95d0-4927-8dda-a228766a4afe", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "767f78e8-a875-44f4-bb0d-64565b88a59d"}]}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:07:49 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=3 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:49 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=7 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:07:49 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-bce5d5f6-083b-4380-b83b-eb68b0cdae83 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] HTTP exception thrown: Block Device 64e45562-95d0-4927-8dda-a228766a4afe is not bootable. Apr 13 23:07:49 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-bce5d5f6-083b-4380-b83b-eb68b0cdae83 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Request method failure captured: Apr 13 23:07:49 user devstack@n-api.service[61611]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 13 23:07:49 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:07:49 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:07:49 user devstack@n-api.service[61611]: Connection: close Apr 13 23:07:49 user devstack@n-api.service[61611]: Content-Length: 356 Apr 13 23:07:49 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:07:49 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:07:49 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:07:49 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:07:49 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIn1WpkCHTcQ3vsm6vuXvLMwBukWR3T78fUteB1g1zobAkavXEwqiMsjm9a7O1wQSAPbhSneJ4g36HRneth-jvcWNhT4bg4W3DOs07jcjQHnm6EdcnPlV6wX56fpXkxsD2Vss9a8TpT8oI4bKWdzWDXg8gRXoxb6iO_eerJkHkQeHrY Apr 13 23:07:49 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:07:49 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:07:49 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:07:49 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:07:49 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:07:49 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:07:49 user devstack@n-api.service[61611]: X-Project-Id: d8a3c684b0414336b2ca770eb1f3ab17 Apr 13 23:07:49 user devstack@n-api.service[61611]: X-Project-Name: tempest-ServersNegativeTestJSON-1433854176 Apr 13 23:07:49 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:07:49 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:07:49 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d8a3c684b0414336b2ca770eb1f3ab17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8a3c684b0414336b2ca770eb1f3ab17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8a3c684b0414336b2ca770eb1f3ab17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:07:49 user devstack@n-api.service[61611]: X-Tenant: tempest-ServersNegativeTestJSON-1433854176 Apr 13 23:07:49 user devstack@n-api.service[61611]: X-Tenant-Id: d8a3c684b0414336b2ca770eb1f3ab17 Apr 13 23:07:49 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1433854176 Apr 13 23:07:49 user devstack@n-api.service[61611]: X-User: tempest-ServersNegativeTestJSON-1433854176-project-member Apr 13 23:07:49 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:07:49 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:07:49 user devstack@n-api.service[61611]: X-User-Id: 71593deacbd74fea9fc2faf5a9b08877 Apr 13 23:07:49 user devstack@n-api.service[61611]: X-User-Name: tempest-ServersNegativeTestJSON-1433854176-project-member Apr 13 23:07:49 user devstack@n-api.service[61611]: Apr 13 23:07:49 user devstack@n-api.service[61611]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-757478972", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "64e45562-95d0-4927-8dda-a228766a4afe", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "767f78e8-a875-44f4-bb0d-64565b88a59d"}]}} Apr 13 23:07:49 user devstack@n-api.service[61611]: method: > Apr 13 23:07:49 user devstack@n-api.service[61611]: exception: Block Device 64e45562-95d0-4927-8dda-a228766a4afe is not bootable. Apr 13 23:07:49 user devstack@n-api.service[61611]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-757478972', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '64e45562-95d0-4927-8dda-a228766a4afe'}], 'networks': [{'uuid': '767f78e8-a875-44f4-bb0d-64565b88a59d'}]}}} Apr 13 23:07:49 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 64e45562-95d0-4927-8dda-a228766a4afe is not bootable. Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 64e45562-95d0-4927-8dda-a228766a4afe is not bootable. Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 64e45562-95d0-4927-8dda-a228766a4afe is not bootable. Apr 13 23:07:49 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:07:49 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-bce5d5f6-083b-4380-b83b-eb68b0cdae83 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Returning 400 to user: Block Device 64e45562-95d0-4927-8dda-a228766a4afe is not bootable. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:07:49 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-bce5d5f6-083b-4380-b83b-eb68b0cdae83 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.074493 Apr 13 23:07:49 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 243/734] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:07:49 2023] POST /compute/v2.1/servers => generated 110 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:07:49 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-3b60b0c3-6655-4b29-bcec-0c18806a0ecf tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:49 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-3b60b0c3-6655-4b29-bcec-0c18806a0ecf tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3b60b0c3-6655-4b29-bcec-0c18806a0ecf tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3b60b0c3-6655-4b29-bcec-0c18806a0ecf tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3b60b0c3-6655-4b29-bcec-0c18806a0ecf tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3b60b0c3-6655-4b29-bcec-0c18806a0ecf tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3b60b0c3-6655-4b29-bcec-0c18806a0ecf tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3b60b0c3-6655-4b29-bcec-0c18806a0ecf tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:49 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-3b60b0c3-6655-4b29-bcec-0c18806a0ecf tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71593deacbd74fea9fc2faf5a9b08877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a3c684b0414336b2ca770eb1f3ab17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:07:49 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-3b60b0c3-6655-4b29-bcec-0c18806a0ecf tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc473fb8-e574-4e49-b860-3ae0066cc9b8" status: 200 len: 1491 microversion: 2.1 time: 0.224452 Apr 13 23:07:49 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 244/735] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:07:49 2023] GET /compute/v2.1/servers/dc473fb8-e574-4e49-b860-3ae0066cc9b8 => generated 1491 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:07:56 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-a8e021af-368a-4253-81d1-8fdb20882bda tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:07:56 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-a8e021af-368a-4253-81d1-8fdb20882bda tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:07:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a8e021af-368a-4253-81d1-8fdb20882bda tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a8e021af-368a-4253-81d1-8fdb20882bda tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a8e021af-368a-4253-81d1-8fdb20882bda tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a8e021af-368a-4253-81d1-8fdb20882bda tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:07:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a8e021af-368a-4253-81d1-8fdb20882bda tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:07:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a8e021af-368a-4253-81d1-8fdb20882bda tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:07:56 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-a8e021af-368a-4253-81d1-8fdb20882bda tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114619485574b9499b5384a9529003f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ecbdf826b849bf995787ada9d4a673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:07:56 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-a8e021af-368a-4253-81d1-8fdb20882bda tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] 10.0.0.210 "GET /compute/v2.1/servers/392704a5-705a-43d0-bab8-801c7ef5b514" status: 200 len: 1486 microversion: 2.1 time: 0.157372 Apr 13 23:07:56 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 249/736] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:07:56 2023] GET /compute/v2.1/servers/392704a5-705a-43d0-bab8-801c7ef5b514 => generated 1486 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:08:01 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:08:01 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-874091226", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "destination_type": "volume"}], "networks": [{"uuid": "7ea834aa-c724-45fb-9c3f-497360beab67"}]}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:08:01 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] validate_networks() for [('7ea834aa-c724-45fb-9c3f-497360beab67', None, None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:08:02 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:08:02 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:08:02 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:08:02 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:08:02 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:08:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:02 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Getting quotas for project 3fe77a2c491c4596ba7e6af3236d7de8. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:08:02 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Getting quotas for user 6db44e7cb89a46c2999916b0a266b159 and project 3fe77a2c491c4596ba7e6af3236d7de8. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:08:02 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:08:02 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:08:02 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.802451 Apr 13 23:08:02 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 244/737] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 23:08:01 2023] POST /compute/v2.1/servers => generated 378 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 23:08:02 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-2801e974-c66d-4500-8dc7-4f54f7a791e9 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:08:02 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-2801e974-c66d-4500-8dc7-4f54f7a791e9 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:08:02 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=5 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:08:02 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=9 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:08:02 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-2801e974-c66d-4500-8dc7-4f54f7a791e9 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:08:02 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-2801e974-c66d-4500-8dc7-4f54f7a791e9 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:08:02 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-2801e974-c66d-4500-8dc7-4f54f7a791e9 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:08:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-2801e974-c66d-4500-8dc7-4f54f7a791e9 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962" status: 200 len: 1394 microversion: 2.87 time: 0.073116 Apr 13 23:08:02 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 245/738] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:08:02 2023] GET /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962 => generated 1394 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:08:04 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-39070d66-8401-4834-aeea-d1487a8b4fa0 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:08:04 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-39070d66-8401-4834-aeea-d1487a8b4fa0 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:08:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-39070d66-8401-4834-aeea-d1487a8b4fa0 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-39070d66-8401-4834-aeea-d1487a8b4fa0 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-39070d66-8401-4834-aeea-d1487a8b4fa0 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-39070d66-8401-4834-aeea-d1487a8b4fa0 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-39070d66-8401-4834-aeea-d1487a8b4fa0 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-39070d66-8401-4834-aeea-d1487a8b4fa0 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:04 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-39070d66-8401-4834-aeea-d1487a8b4fa0 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066230 Apr 13 23:08:04 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 250/739] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:08:04 2023] GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 23:08:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:08:04 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:08:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:04 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:08:05 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195" status: 204 len: 0 microversion: 2.1 time: 0.325034 Apr 13 23:08:05 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 245/740] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:08:04 2023] DELETE /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:08:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-48ba7c9c-4c59-4c27-ba51-94fb988065cb tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:08:05 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-48ba7c9c-4c59-4c27-ba51-94fb988065cb tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:08:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-48ba7c9c-4c59-4c27-ba51-94fb988065cb tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-48ba7c9c-4c59-4c27-ba51-94fb988065cb tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-48ba7c9c-4c59-4c27-ba51-94fb988065cb tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-48ba7c9c-4c59-4c27-ba51-94fb988065cb tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-48ba7c9c-4c59-4c27-ba51-94fb988065cb tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-48ba7c9c-4c59-4c27-ba51-94fb988065cb tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-3dba1400-d05e-41e4-80bf-03bd552f8277 req-50c03061-559a-441f-9826-c0b2a1428556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9e9744c-04d3-486e-b032-90c672927962", "tag": "7ae6b103-e1c6-42e6-9fcd-e76353955a76"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:08:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3dba1400-d05e-41e4-80bf-03bd552f8277 req-50c03061-559a-441f-9826-c0b2a1428556 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3dba1400-d05e-41e4-80bf-03bd552f8277 req-50c03061-559a-441f-9826-c0b2a1428556 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3dba1400-d05e-41e4-80bf-03bd552f8277 req-50c03061-559a-441f-9826-c0b2a1428556 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:05 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-3dba1400-d05e-41e4-80bf-03bd552f8277 req-50c03061-559a-441f-9826-c0b2a1428556 service nova] Creating event network-changed:7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance a9e9744c-04d3-486e-b032-90c672927962 on user Apr 13 23:08:05 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-3dba1400-d05e-41e4-80bf-03bd552f8277 req-50c03061-559a-441f-9826-c0b2a1428556 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033877 Apr 13 23:08:05 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 251/741] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:08:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:08:05 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-48ba7c9c-4c59-4c27-ba51-94fb988065cb tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:08:05 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-48ba7c9c-4c59-4c27-ba51-94fb988065cb tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195" status: 200 len: 1678 microversion: 2.1 time: 0.187298 Apr 13 23:08:05 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 246/742] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:08:05 2023] GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195 => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 23:08:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-252cc4bd-81c1-4275-930b-3a5544e40573 req-ff21b370-1224-43c8-b5d4-d4e629778d8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "name": "network-vif-unplugged", "status": "completed", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:08:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-252cc4bd-81c1-4275-930b-3a5544e40573 req-ff21b370-1224-43c8-b5d4-d4e629778d8f service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-252cc4bd-81c1-4275-930b-3a5544e40573 req-ff21b370-1224-43c8-b5d4-d4e629778d8f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-252cc4bd-81c1-4275-930b-3a5544e40573 req-ff21b370-1224-43c8-b5d4-d4e629778d8f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:05 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-252cc4bd-81c1-4275-930b-3a5544e40573 req-ff21b370-1224-43c8-b5d4-d4e629778d8f service nova] Creating event network-vif-unplugged:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:08:05 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-252cc4bd-81c1-4275-930b-3a5544e40573 req-ff21b370-1224-43c8-b5d4-d4e629778d8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040235 Apr 13 23:08:05 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 246/743] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:08:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:08:07 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-70281f7c-7426-47c4-a407-f9098bdeb941 req-5144e55e-32db-46a1-85cc-09bb0c615a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "name": "network-vif-deleted", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:08:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-70281f7c-7426-47c4-a407-f9098bdeb941 req-5144e55e-32db-46a1-85cc-09bb0c615a2e service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-70281f7c-7426-47c4-a407-f9098bdeb941 req-5144e55e-32db-46a1-85cc-09bb0c615a2e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-70281f7c-7426-47c4-a407-f9098bdeb941 req-5144e55e-32db-46a1-85cc-09bb0c615a2e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:07 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-70281f7c-7426-47c4-a407-f9098bdeb941 req-5144e55e-32db-46a1-85cc-09bb0c615a2e service nova] Creating event network-vif-deleted:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:08:07 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-70281f7c-7426-47c4-a407-f9098bdeb941 req-5144e55e-32db-46a1-85cc-09bb0c615a2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036674 Apr 13 23:08:07 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 252/744] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:08:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:08:07 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-60ba6d89-9a35-4bf9-a11d-a55f5e56f4d8 req-3e447e25-e246-47d3-959a-c01b3142336e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb24b5e-f858-4068-88c5-3c7708c7e195", "name": "network-vif-plugged", "status": "completed", "tag": "c7f804a4-0e8d-4d99-a547-5c9252cb872c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:08:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-60ba6d89-9a35-4bf9-a11d-a55f5e56f4d8 req-3e447e25-e246-47d3-959a-c01b3142336e service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-60ba6d89-9a35-4bf9-a11d-a55f5e56f4d8 req-3e447e25-e246-47d3-959a-c01b3142336e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-60ba6d89-9a35-4bf9-a11d-a55f5e56f4d8 req-3e447e25-e246-47d3-959a-c01b3142336e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-60ba6d89-9a35-4bf9-a11d-a55f5e56f4d8 req-3e447e25-e246-47d3-959a-c01b3142336e service nova] Creating event network-vif-plugged:c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance deb24b5e-f858-4068-88c5-3c7708c7e195 on user Apr 13 23:08:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-60ba6d89-9a35-4bf9-a11d-a55f5e56f4d8 req-3e447e25-e246-47d3-959a-c01b3142336e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029827 Apr 13 23:08:07 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 247/745] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:08:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:08:14 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:08:14 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:08:14 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-083a3826-035e-4916-a99a-6be07a826fe7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:08:14 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-083a3826-035e-4916-a99a-6be07a826fe7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:08:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-083a3826-035e-4916-a99a-6be07a826fe7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-083a3826-035e-4916-a99a-6be07a826fe7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-083a3826-035e-4916-a99a-6be07a826fe7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-083a3826-035e-4916-a99a-6be07a826fe7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-083a3826-035e-4916-a99a-6be07a826fe7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-083a3826-035e-4916-a99a-6be07a826fe7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:14 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-083a3826-035e-4916-a99a-6be07a826fe7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:08:14 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-083a3826-035e-4916-a99a-6be07a826fe7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1539 microversion: 2.1 time: 0.345224 Apr 13 23:08:14 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 247/746] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:08:14 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1539 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:08:15 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-d288996a-b7e2-46c5-92d9-2a943aca8961 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:08:15 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-d288996a-b7e2-46c5-92d9-2a943aca8961 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:08:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d288996a-b7e2-46c5-92d9-2a943aca8961 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d288996a-b7e2-46c5-92d9-2a943aca8961 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d288996a-b7e2-46c5-92d9-2a943aca8961 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d288996a-b7e2-46c5-92d9-2a943aca8961 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d288996a-b7e2-46c5-92d9-2a943aca8961 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d288996a-b7e2-46c5-92d9-2a943aca8961 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:16 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-d288996a-b7e2-46c5-92d9-2a943aca8961 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:08:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-d288996a-b7e2-46c5-92d9-2a943aca8961 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a9f5f1f-cc46-4c3c-834d-daa002031ee3" status: 200 len: 1440 microversion: 2.1 time: 0.162721 Apr 13 23:08:16 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 253/747] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:08:15 2023] GET /compute/v2.1/servers/1a9f5f1f-cc46-4c3c-834d-daa002031ee3 => generated 1440 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:08:17 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:08:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-8db1d6da-d98a-410c-814f-ce4a309a10cb req-28957d67-10b3-4381-b4a8-174177529aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e9744c-04d3-486e-b032-90c672927962", "name": "network-vif-plugged", "status": "completed", "tag": "7ae6b103-e1c6-42e6-9fcd-e76353955a76"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:08:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-8db1d6da-d98a-410c-814f-ce4a309a10cb req-28957d67-10b3-4381-b4a8-174177529aee service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-8db1d6da-d98a-410c-814f-ce4a309a10cb req-28957d67-10b3-4381-b4a8-174177529aee service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-8db1d6da-d98a-410c-814f-ce4a309a10cb req-28957d67-10b3-4381-b4a8-174177529aee service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:17 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-8db1d6da-d98a-410c-814f-ce4a309a10cb req-28957d67-10b3-4381-b4a8-174177529aee service nova] Creating event network-vif-plugged:7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance a9e9744c-04d3-486e-b032-90c672927962 on user Apr 13 23:08:17 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-8db1d6da-d98a-410c-814f-ce4a309a10cb req-28957d67-10b3-4381-b4a8-174177529aee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057657 Apr 13 23:08:17 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 248/748] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:08:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:08:19 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-57ea01ab-3c53-4e46-a996-685aba82dea0 req-f3e67b1f-9962-4ece-907a-a6b327201e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e9744c-04d3-486e-b032-90c672927962", "name": "network-vif-plugged", "status": "completed", "tag": "7ae6b103-e1c6-42e6-9fcd-e76353955a76"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:08:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-57ea01ab-3c53-4e46-a996-685aba82dea0 req-f3e67b1f-9962-4ece-907a-a6b327201e53 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-57ea01ab-3c53-4e46-a996-685aba82dea0 req-f3e67b1f-9962-4ece-907a-a6b327201e53 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-57ea01ab-3c53-4e46-a996-685aba82dea0 req-f3e67b1f-9962-4ece-907a-a6b327201e53 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-57ea01ab-3c53-4e46-a996-685aba82dea0 req-f3e67b1f-9962-4ece-907a-a6b327201e53 service nova] Creating event network-vif-plugged:7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance a9e9744c-04d3-486e-b032-90c672927962 on user Apr 13 23:08:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-57ea01ab-3c53-4e46-a996-685aba82dea0 req-f3e67b1f-9962-4ece-907a-a6b327201e53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033089 Apr 13 23:08:19 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 248/749] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:08:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:08:24 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-317150459", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "networks": [{"uuid": "6d2922dc-e5ab-475a-9b4e-453595ade8a1"}]}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:08:24 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] validate_networks() for [('6d2922dc-e5ab-475a-9b4e-453595ade8a1', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:08:25 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:08:25 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:08:25 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:08:25 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:08:25 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:08:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:25 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Getting quotas for project c6455f36704e4b3088d8a9114b087fd3. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:08:25 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Getting quotas for user 8c235879bc444a819061c4bb4bf3441b and project c6455f36704e4b3088d8a9114b087fd3. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:08:25 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:08:25 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:08:25 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.041649 Apr 13 23:08:25 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 254/750] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:08:24 2023] POST /compute/v2.1/servers => generated 378 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:08:25 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-14bdd664-2e72-4845-bdb7-7986eed8143d tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:08:25 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-14bdd664-2e72-4845-bdb7-7986eed8143d tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:08:25 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-14bdd664-2e72-4845-bdb7-7986eed8143d tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c235879bc444a819061c4bb4bf3441b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6455f36704e4b3088d8a9114b087fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:08:25 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-14bdd664-2e72-4845-bdb7-7986eed8143d tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3dc82c4-502a-4ff9-a230-129269f5c0e6" status: 200 len: 1207 microversion: 2.1 time: 0.067936 Apr 13 23:08:25 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 249/751] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:08:25 2023] GET /compute/v2.1/servers/d3dc82c4-502a-4ff9-a230-129269f5c0e6 => generated 1207 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:08:28 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-dfbeb3c3-2e81-41cb-ab71-541e451705ed req-c1af3c45-0906-4494-946e-6fd26bbde6dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3dc82c4-502a-4ff9-a230-129269f5c0e6", "tag": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:08:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-dfbeb3c3-2e81-41cb-ab71-541e451705ed req-c1af3c45-0906-4494-946e-6fd26bbde6dd service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-dfbeb3c3-2e81-41cb-ab71-541e451705ed req-c1af3c45-0906-4494-946e-6fd26bbde6dd service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-dfbeb3c3-2e81-41cb-ab71-541e451705ed req-c1af3c45-0906-4494-946e-6fd26bbde6dd service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:28 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-dfbeb3c3-2e81-41cb-ab71-541e451705ed req-c1af3c45-0906-4494-946e-6fd26bbde6dd service nova] Creating event network-changed:b572f64e-cfdf-4d37-8ac3-6776b86a2c23 for instance d3dc82c4-502a-4ff9-a230-129269f5c0e6 on user Apr 13 23:08:28 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-dfbeb3c3-2e81-41cb-ab71-541e451705ed req-c1af3c45-0906-4494-946e-6fd26bbde6dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101632 Apr 13 23:08:28 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 249/752] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:08:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:08:28 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8cb45f2e-10df-4e5e-97f1-c87873708d7e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:08:28 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-8cb45f2e-10df-4e5e-97f1-c87873708d7e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:08:28 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:08:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8cb45f2e-10df-4e5e-97f1-c87873708d7e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8cb45f2e-10df-4e5e-97f1-c87873708d7e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8cb45f2e-10df-4e5e-97f1-c87873708d7e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8cb45f2e-10df-4e5e-97f1-c87873708d7e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8cb45f2e-10df-4e5e-97f1-c87873708d7e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8cb45f2e-10df-4e5e-97f1-c87873708d7e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:28 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=26 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:08:28 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-8cb45f2e-10df-4e5e-97f1-c87873708d7e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] HTTP exception thrown: Instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 could not be found. Apr 13 23:08:28 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8cb45f2e-10df-4e5e-97f1-c87873708d7e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Request method failure captured: Apr 13 23:08:28 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2 HTTP/1.1 Apr 13 23:08:28 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:08:28 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:08:28 user devstack@n-api.service[61613]: Connection: close Apr 13 23:08:28 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:08:28 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:08:28 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:08:28 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:08:28 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:08:28 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIiqmOc_jLwesAQk99mPpAwX4yPkvI4gxc0CX79zo2U49YpOkE1P1Vgrgx0AIOV4uSWhOhTpAt3ClJ1sc2omO3e6uzmuNuDjNfjdF-ljuOMYFVYPTVI7GUSixFeXrIvRxQWRt5GRaZsPC5aFcdH4Eq-k5brL5De7wLsJ-zubuNON-es Apr 13 23:08:28 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:08:28 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:08:28 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:08:28 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:08:28 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:08:28 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:08:28 user devstack@n-api.service[61613]: X-Project-Id: cf532d1c87a34b8cbde0f162688f7cdb Apr 13 23:08:28 user devstack@n-api.service[61613]: X-Project-Name: tempest-TestMinimumBasicScenario-146514025 Apr 13 23:08:28 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:08:28 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:08:28 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf532d1c87a34b8cbde0f162688f7cdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf532d1c87a34b8cbde0f162688f7cdb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf532d1c87a34b8cbde0f162688f7cdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:08:28 user devstack@n-api.service[61613]: X-Tenant: tempest-TestMinimumBasicScenario-146514025 Apr 13 23:08:28 user devstack@n-api.service[61613]: X-Tenant-Id: cf532d1c87a34b8cbde0f162688f7cdb Apr 13 23:08:28 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-TestMinimumBasicScenario-146514025 Apr 13 23:08:28 user devstack@n-api.service[61613]: X-User: tempest-TestMinimumBasicScenario-146514025-project-member Apr 13 23:08:28 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:08:28 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:08:28 user devstack@n-api.service[61613]: X-User-Id: fad76e3a6e154feaa62d95f6e7d1ce1c Apr 13 23:08:28 user devstack@n-api.service[61613]: X-User-Name: tempest-TestMinimumBasicScenario-146514025-project-member Apr 13 23:08:28 user devstack@n-api.service[61613]: method: > Apr 13 23:08:28 user devstack@n-api.service[61613]: exception: Instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 could not be found. Apr 13 23:08:28 user devstack@n-api.service[61613]: action_args: {'id': '70c7e35a-9a30-44ff-bb5f-74d122bf08d2'} Apr 13 23:08:28 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 could not be found. Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 could not be found. Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 could not be found. Apr 13 23:08:28 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:08:28 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8cb45f2e-10df-4e5e-97f1-c87873708d7e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Returning 404 to user: Instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:08:28 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-8cb45f2e-10df-4e5e-97f1-c87873708d7e tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2" status: 404 len: 111 microversion: 2.1 time: 0.032887 Apr 13 23:08:28 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 255/753] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:08:28 2023] GET /compute/v2.1/servers/70c7e35a-9a30-44ff-bb5f-74d122bf08d2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:08:28 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-68199eb0-d08e-4dc3-94e9-7ffdc4cfa6a6 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Calling method '.version_select at 0x7f3d1dc489d0>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:08:28 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=10 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:08:28 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-68199eb0-d08e-4dc3-94e9-7ffdc4cfa6a6 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1134301175" status: 202 len: 0 microversion: 2.1 time: 0.026826 Apr 13 23:08:28 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 250/754] 10.0.0.210 () {62 vars in 1349 bytes} [Thu Apr 13 23:08:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1134301175 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:08:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-5f857946-c933-4602-99e6-366efec6b1a9 req-43624a34-8f1a-4bf7-a555-53d08e0194d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3dc82c4-502a-4ff9-a230-129269f5c0e6", "name": "network-vif-plugged", "status": "completed", "tag": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:08:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5f857946-c933-4602-99e6-366efec6b1a9 req-43624a34-8f1a-4bf7-a555-53d08e0194d1 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5f857946-c933-4602-99e6-366efec6b1a9 req-43624a34-8f1a-4bf7-a555-53d08e0194d1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5f857946-c933-4602-99e6-366efec6b1a9 req-43624a34-8f1a-4bf7-a555-53d08e0194d1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:30 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-5f857946-c933-4602-99e6-366efec6b1a9 req-43624a34-8f1a-4bf7-a555-53d08e0194d1 service nova] Creating event network-vif-plugged:b572f64e-cfdf-4d37-8ac3-6776b86a2c23 for instance d3dc82c4-502a-4ff9-a230-129269f5c0e6 on user Apr 13 23:08:30 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-5f857946-c933-4602-99e6-366efec6b1a9 req-43624a34-8f1a-4bf7-a555-53d08e0194d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099151 Apr 13 23:08:30 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 250/755] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:08:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:08:32 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-d4a9780c-7eb7-47f8-9ace-dec160a69e9b req-c2f5b9aa-fd39-4fc4-8598-d537001f21ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3dc82c4-502a-4ff9-a230-129269f5c0e6", "name": "network-vif-plugged", "status": "completed", "tag": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:08:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d4a9780c-7eb7-47f8-9ace-dec160a69e9b req-c2f5b9aa-fd39-4fc4-8598-d537001f21ce service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d4a9780c-7eb7-47f8-9ace-dec160a69e9b req-c2f5b9aa-fd39-4fc4-8598-d537001f21ce service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d4a9780c-7eb7-47f8-9ace-dec160a69e9b req-c2f5b9aa-fd39-4fc4-8598-d537001f21ce service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:32 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-d4a9780c-7eb7-47f8-9ace-dec160a69e9b req-c2f5b9aa-fd39-4fc4-8598-d537001f21ce service nova] Creating event network-vif-plugged:b572f64e-cfdf-4d37-8ac3-6776b86a2c23 for instance d3dc82c4-502a-4ff9-a230-129269f5c0e6 on user Apr 13 23:08:32 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-d4a9780c-7eb7-47f8-9ace-dec160a69e9b req-c2f5b9aa-fd39-4fc4-8598-d537001f21ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046569 Apr 13 23:08:32 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 256/756] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:08:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:08:49 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:08:49 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:08:49 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-ce955626-a7ee-41c3-bd99-9ae4a8129646 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:08:49 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-ce955626-a7ee-41c3-bd99-9ae4a8129646 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:08:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ce955626-a7ee-41c3-bd99-9ae4a8129646 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ce955626-a7ee-41c3-bd99-9ae4a8129646 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ce955626-a7ee-41c3-bd99-9ae4a8129646 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ce955626-a7ee-41c3-bd99-9ae4a8129646 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ce955626-a7ee-41c3-bd99-9ae4a8129646 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ce955626-a7ee-41c3-bd99-9ae4a8129646 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:49 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-ce955626-a7ee-41c3-bd99-9ae4a8129646 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71593deacbd74fea9fc2faf5a9b08877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a3c684b0414336b2ca770eb1f3ab17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:08:49 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-ce955626-a7ee-41c3-bd99-9ae4a8129646 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc473fb8-e574-4e49-b860-3ae0066cc9b8" status: 200 len: 1491 microversion: 2.1 time: 0.191461 Apr 13 23:08:49 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 251/757] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:08:49 2023] GET /compute/v2.1/servers/dc473fb8-e574-4e49-b860-3ae0066cc9b8 => generated 1491 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:08:52 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:08:52 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:08:52 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-ed0de253-9d61-42e4-8763-d63c6e1be336 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:08:52 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-ed0de253-9d61-42e4-8763-d63c6e1be336 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:08:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ed0de253-9d61-42e4-8763-d63c6e1be336 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ed0de253-9d61-42e4-8763-d63c6e1be336 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ed0de253-9d61-42e4-8763-d63c6e1be336 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ed0de253-9d61-42e4-8763-d63c6e1be336 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ed0de253-9d61-42e4-8763-d63c6e1be336 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ed0de253-9d61-42e4-8763-d63c6e1be336 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:52 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-ed0de253-9d61-42e4-8763-d63c6e1be336 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:08:52 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-ed0de253-9d61-42e4-8763-d63c6e1be336 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:08:52 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-ed0de253-9d61-42e4-8763-d63c6e1be336 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:08:52 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-ed0de253-9d61-42e4-8763-d63c6e1be336 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962" status: 200 len: 1768 microversion: 2.87 time: 0.176182 Apr 13 23:08:52 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 251/758] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:08:52 2023] GET /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962 => generated 1768 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:08:55 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-be551bf7-81df-4083-9137-4f47c06a8e8f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:08:55 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-be551bf7-81df-4083-9137-4f47c06a8e8f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:08:55 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:08:55 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:08:55 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=3 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:08:55 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=3 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:08:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-be551bf7-81df-4083-9137-4f47c06a8e8f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-be551bf7-81df-4083-9137-4f47c06a8e8f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-be551bf7-81df-4083-9137-4f47c06a8e8f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-be551bf7-81df-4083-9137-4f47c06a8e8f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:08:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-be551bf7-81df-4083-9137-4f47c06a8e8f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:08:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-be551bf7-81df-4083-9137-4f47c06a8e8f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:08:55 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-be551bf7-81df-4083-9137-4f47c06a8e8f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] HTTP exception thrown: Instance deb24b5e-f858-4068-88c5-3c7708c7e195 could not be found. Apr 13 23:08:55 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-be551bf7-81df-4083-9137-4f47c06a8e8f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Request method failure captured: Apr 13 23:08:55 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195 HTTP/1.1 Apr 13 23:08:55 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:08:55 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:08:55 user devstack@n-api.service[61613]: Connection: close Apr 13 23:08:55 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:08:55 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:08:55 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:08:55 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:08:55 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:08:55 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIfHQxdyZtX-iu-ThNLEChPZxANikiWLMMCIRZ25gQuq3VxddslsqUB5ikMLZ2ePv4vTU-JsJ6azIW7Ww-AQ-OdqvQt7Sws4Wi7PO44E5yqLWKj1QiMLUT5MdNcavqRLksBSt368wMT-Wgo0vOgAq25fxnYJ3kH5oYJcbmhrlbtbUaQ Apr 13 23:08:55 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:08:55 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:08:55 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:08:55 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:08:55 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:08:55 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:08:55 user devstack@n-api.service[61613]: X-Project-Id: 5b6a1fccc07f4f5a8f8f8617ae03955d Apr 13 23:08:55 user devstack@n-api.service[61613]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-258614246 Apr 13 23:08:55 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:08:55 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:08:55 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5b6a1fccc07f4f5a8f8f8617ae03955d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b6a1fccc07f4f5a8f8f8617ae03955d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b6a1fccc07f4f5a8f8f8617ae03955d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:08:55 user devstack@n-api.service[61613]: X-Tenant: tempest-ServerRescueNegativeTestJSON-258614246 Apr 13 23:08:55 user devstack@n-api.service[61613]: X-Tenant-Id: 5b6a1fccc07f4f5a8f8f8617ae03955d Apr 13 23:08:55 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-258614246 Apr 13 23:08:55 user devstack@n-api.service[61613]: X-User: tempest-ServerRescueNegativeTestJSON-258614246-project-member Apr 13 23:08:55 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:08:55 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:08:55 user devstack@n-api.service[61613]: X-User-Id: 28cb6d8d6e3d4ef7aa53bb17faf495c4 Apr 13 23:08:55 user devstack@n-api.service[61613]: X-User-Name: tempest-ServerRescueNegativeTestJSON-258614246-project-member Apr 13 23:08:55 user devstack@n-api.service[61613]: method: > Apr 13 23:08:55 user devstack@n-api.service[61613]: exception: Instance deb24b5e-f858-4068-88c5-3c7708c7e195 could not be found. Apr 13 23:08:55 user devstack@n-api.service[61613]: action_args: {'id': 'deb24b5e-f858-4068-88c5-3c7708c7e195'} Apr 13 23:08:55 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deb24b5e-f858-4068-88c5-3c7708c7e195 could not be found. Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deb24b5e-f858-4068-88c5-3c7708c7e195 could not be found. Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deb24b5e-f858-4068-88c5-3c7708c7e195 could not be found. Apr 13 23:08:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:08:55 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-be551bf7-81df-4083-9137-4f47c06a8e8f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Returning 404 to user: Instance deb24b5e-f858-4068-88c5-3c7708c7e195 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:08:55 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-be551bf7-81df-4083-9137-4f47c06a8e8f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195" status: 404 len: 111 microversion: 2.1 time: 0.050497 Apr 13 23:08:55 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 257/759] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:08:55 2023] GET /compute/v2.1/servers/deb24b5e-f858-4068-88c5-3c7708c7e195 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:08:55 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-aeaa23c8-eeee-455d-85b3-2d75919b614f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '.version_select at 0x7f3d1dc975b0>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:08:55 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-aeaa23c8-eeee-455d-85b3-2d75919b614f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129500402" status: 202 len: 0 microversion: 2.1 time: 0.025320 Apr 13 23:08:55 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 252/760] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 23:08:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129500402 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:09:02 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:09:02 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:09:02 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:09:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:02 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:09:02 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ff417f05-3cfa-4274-a0d9-9145ce1e5f83" status: 204 len: 0 microversion: 2.1 time: 0.121123 Apr 13 23:09:02 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 252/761] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:09:02 2023] DELETE /compute/v2.1/servers/ff417f05-3cfa-4274-a0d9-9145ce1e5f83 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:09:02 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e6982590-7114-4a28-a46c-ad89e44ff83a tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:09:02 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-e6982590-7114-4a28-a46c-ad89e44ff83a tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:09:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e6982590-7114-4a28-a46c-ad89e44ff83a tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e6982590-7114-4a28-a46c-ad89e44ff83a tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e6982590-7114-4a28-a46c-ad89e44ff83a tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e6982590-7114-4a28-a46c-ad89e44ff83a tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e6982590-7114-4a28-a46c-ad89e44ff83a tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e6982590-7114-4a28-a46c-ad89e44ff83a tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:03 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-e6982590-7114-4a28-a46c-ad89e44ff83a tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:09:03 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-e6982590-7114-4a28-a46c-ad89e44ff83a tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff417f05-3cfa-4274-a0d9-9145ce1e5f83" status: 200 len: 1497 microversion: 2.1 time: 0.189902 Apr 13 23:09:03 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 258/762] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:09:02 2023] GET /compute/v2.1/servers/ff417f05-3cfa-4274-a0d9-9145ce1e5f83 => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:09:03 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-e59f455e-dc04-489d-8f65-e53afac8d77e req-8b010792-1a2b-4c5e-9c5f-b10f0cac102a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff417f05-3cfa-4274-a0d9-9145ce1e5f83", "name": "network-vif-unplugged", "status": "completed", "tag": "ac600f3d-8b2c-4200-81dd-3d35843d3f28"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:09:03 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:09:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e59f455e-dc04-489d-8f65-e53afac8d77e req-8b010792-1a2b-4c5e-9c5f-b10f0cac102a service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e59f455e-dc04-489d-8f65-e53afac8d77e req-8b010792-1a2b-4c5e-9c5f-b10f0cac102a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e59f455e-dc04-489d-8f65-e53afac8d77e req-8b010792-1a2b-4c5e-9c5f-b10f0cac102a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:03 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-e59f455e-dc04-489d-8f65-e53afac8d77e req-8b010792-1a2b-4c5e-9c5f-b10f0cac102a service nova] Creating event network-vif-unplugged:ac600f3d-8b2c-4200-81dd-3d35843d3f28 for instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 on user Apr 13 23:09:03 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-e59f455e-dc04-489d-8f65-e53afac8d77e req-8b010792-1a2b-4c5e-9c5f-b10f0cac102a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036270 Apr 13 23:09:03 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 253/763] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:09:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:09:03 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:09:03 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:09:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:04 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:09:04 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-784df969-87dd-4add-9df0-1dddbff4306f req-0f90f7f8-3e40-45fa-a053-6c4180ea9eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff417f05-3cfa-4274-a0d9-9145ce1e5f83", "name": "network-vif-deleted", "tag": "ac600f3d-8b2c-4200-81dd-3d35843d3f28"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:09:04 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/392704a5-705a-43d0-bab8-801c7ef5b514" status: 204 len: 0 microversion: 2.1 time: 0.156716 Apr 13 23:09:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-784df969-87dd-4add-9df0-1dddbff4306f req-0f90f7f8-3e40-45fa-a053-6c4180ea9eae service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-784df969-87dd-4add-9df0-1dddbff4306f req-0f90f7f8-3e40-45fa-a053-6c4180ea9eae service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:04 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 253/764] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:09:03 2023] DELETE /compute/v2.1/servers/392704a5-705a-43d0-bab8-801c7ef5b514 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:09:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-784df969-87dd-4add-9df0-1dddbff4306f req-0f90f7f8-3e40-45fa-a053-6c4180ea9eae service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:04 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-07ace654-3491-406b-b173-78d23e759eb2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:09:04 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-07ace654-3491-406b-b173-78d23e759eb2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:09:04 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-784df969-87dd-4add-9df0-1dddbff4306f req-0f90f7f8-3e40-45fa-a053-6c4180ea9eae service nova] Creating event network-vif-deleted:ac600f3d-8b2c-4200-81dd-3d35843d3f28 for instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 on user Apr 13 23:09:04 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-784df969-87dd-4add-9df0-1dddbff4306f req-0f90f7f8-3e40-45fa-a053-6c4180ea9eae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042140 Apr 13 23:09:04 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 259/765] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:09:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:09:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-07ace654-3491-406b-b173-78d23e759eb2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-07ace654-3491-406b-b173-78d23e759eb2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-07ace654-3491-406b-b173-78d23e759eb2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-07ace654-3491-406b-b173-78d23e759eb2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-07ace654-3491-406b-b173-78d23e759eb2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-07ace654-3491-406b-b173-78d23e759eb2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:04 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-07ace654-3491-406b-b173-78d23e759eb2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114619485574b9499b5384a9529003f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ecbdf826b849bf995787ada9d4a673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:09:04 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-07ace654-3491-406b-b173-78d23e759eb2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] 10.0.0.210 "GET /compute/v2.1/servers/392704a5-705a-43d0-bab8-801c7ef5b514" status: 200 len: 1492 microversion: 2.1 time: 0.251569 Apr 13 23:09:04 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 254/766] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:09:04 2023] GET /compute/v2.1/servers/392704a5-705a-43d0-bab8-801c7ef5b514 => generated 1492 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 23:09:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff417f05-3cfa-4274-a0d9-9145ce1e5f83", "name": "network-vif-plugged", "status": "completed", "tag": "ac600f3d-8b2c-4200-81dd-3d35843d3f28"}, {"server_uuid": "392704a5-705a-43d0-bab8-801c7ef5b514", "name": "network-vif-unplugged", "status": "completed", "tag": "e6adbdf3-3dac-401e-a86f-51f53230f579"}, {"server_uuid": "392704a5-705a-43d0-bab8-801c7ef5b514", "name": "network-vif-plugged", "status": "completed", "tag": "e6adbdf3-3dac-401e-a86f-51f53230f579"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:09:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:05 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] Creating event network-vif-plugged:ac600f3d-8b2c-4200-81dd-3d35843d3f28 for instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 on user Apr 13 23:09:05 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] Creating event network-vif-unplugged:e6adbdf3-3dac-401e-a86f-51f53230f579 for instance 392704a5-705a-43d0-bab8-801c7ef5b514 on user Apr 13 23:09:05 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] Creating event network-vif-plugged:e6adbdf3-3dac-401e-a86f-51f53230f579 for instance 392704a5-705a-43d0-bab8-801c7ef5b514 on user Apr 13 23:09:05 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.034736 Apr 13 23:09:05 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 254/767] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:09:05 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:09:06 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-85053978-c3fb-4c4a-bf48-d9c9828de49d req-6d0adf11-932e-4d49-baf3-0e6f03e9d1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392704a5-705a-43d0-bab8-801c7ef5b514", "name": "network-vif-deleted", "tag": "e6adbdf3-3dac-401e-a86f-51f53230f579"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:09:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-85053978-c3fb-4c4a-bf48-d9c9828de49d req-6d0adf11-932e-4d49-baf3-0e6f03e9d1a3 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-85053978-c3fb-4c4a-bf48-d9c9828de49d req-6d0adf11-932e-4d49-baf3-0e6f03e9d1a3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-85053978-c3fb-4c4a-bf48-d9c9828de49d req-6d0adf11-932e-4d49-baf3-0e6f03e9d1a3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-85053978-c3fb-4c4a-bf48-d9c9828de49d req-6d0adf11-932e-4d49-baf3-0e6f03e9d1a3 service nova] Creating event network-vif-deleted:e6adbdf3-3dac-401e-a86f-51f53230f579 for instance 392704a5-705a-43d0-bab8-801c7ef5b514 on user Apr 13 23:09:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-85053978-c3fb-4c4a-bf48-d9c9828de49d req-6d0adf11-932e-4d49-baf3-0e6f03e9d1a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029410 Apr 13 23:09:06 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 260/768] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:09:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:09:14 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-dc28c921-cf3a-4287-a06f-4bcaf4fdf001 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:09:14 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-dc28c921-cf3a-4287-a06f-4bcaf4fdf001 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:09:14 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:09:14 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=8 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:09:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dc28c921-cf3a-4287-a06f-4bcaf4fdf001 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dc28c921-cf3a-4287-a06f-4bcaf4fdf001 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dc28c921-cf3a-4287-a06f-4bcaf4fdf001 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dc28c921-cf3a-4287-a06f-4bcaf4fdf001 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dc28c921-cf3a-4287-a06f-4bcaf4fdf001 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dc28c921-cf3a-4287-a06f-4bcaf4fdf001 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:14 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-dc28c921-cf3a-4287-a06f-4bcaf4fdf001 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.097625 Apr 13 23:09:14 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 255/769] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 23:09:14 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/os-interface => generated 282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:09:15 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:09:15 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:09:15 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-65d7020a-05c3-4069-a938-78b037356d9e tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:09:15 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-65d7020a-05c3-4069-a938-78b037356d9e tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:09:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-65d7020a-05c3-4069-a938-78b037356d9e tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-65d7020a-05c3-4069-a938-78b037356d9e tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-65d7020a-05c3-4069-a938-78b037356d9e tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-65d7020a-05c3-4069-a938-78b037356d9e tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-65d7020a-05c3-4069-a938-78b037356d9e tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-65d7020a-05c3-4069-a938-78b037356d9e tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:15 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-ba2ba1e0-3aef-43d0-bc9a-3316f8c050cb req-cbfa82ce-953c-43e3-a293-5e6d4e66058a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d", "tag": "09cc0c17-bd49-4207-9de4-89178a1e681e"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:09:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-ba2ba1e0-3aef-43d0-bc9a-3316f8c050cb req-cbfa82ce-953c-43e3-a293-5e6d4e66058a service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-ba2ba1e0-3aef-43d0-bc9a-3316f8c050cb req-cbfa82ce-953c-43e3-a293-5e6d4e66058a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-ba2ba1e0-3aef-43d0-bc9a-3316f8c050cb req-cbfa82ce-953c-43e3-a293-5e6d4e66058a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:15 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-ba2ba1e0-3aef-43d0-bc9a-3316f8c050cb req-cbfa82ce-953c-43e3-a293-5e6d4e66058a service nova] Creating event network-changed:09cc0c17-bd49-4207-9de4-89178a1e681e for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d on user Apr 13 23:09:15 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-ba2ba1e0-3aef-43d0-bc9a-3316f8c050cb req-cbfa82ce-953c-43e3-a293-5e6d4e66058a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039824 Apr 13 23:09:15 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 261/770] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:09:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:09:15 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-65d7020a-05c3-4069-a938-78b037356d9e tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c235879bc444a819061c4bb4bf3441b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6455f36704e4b3088d8a9114b087fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:09:15 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-65d7020a-05c3-4069-a938-78b037356d9e tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3dc82c4-502a-4ff9-a230-129269f5c0e6" status: 200 len: 1484 microversion: 2.1 time: 0.182943 Apr 13 23:09:15 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-bad636ed-7475-494c-9f93-727a5fe282b8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:09:15 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-bad636ed-7475-494c-9f93-727a5fe282b8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:09:15 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 255/771] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:09:15 2023] GET /compute/v2.1/servers/d3dc82c4-502a-4ff9-a230-129269f5c0e6 => generated 1484 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:09:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bad636ed-7475-494c-9f93-727a5fe282b8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bad636ed-7475-494c-9f93-727a5fe282b8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bad636ed-7475-494c-9f93-727a5fe282b8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bad636ed-7475-494c-9f93-727a5fe282b8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bad636ed-7475-494c-9f93-727a5fe282b8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bad636ed-7475-494c-9f93-727a5fe282b8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:15 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-bad636ed-7475-494c-9f93-727a5fe282b8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:09:15 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-bad636ed-7475-494c-9f93-727a5fe282b8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1539 microversion: 2.1 time: 0.157520 Apr 13 23:09:15 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 256/772] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:09:15 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1539 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:09:15 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5704ff30-fb85-4624-8bd6-298ccaca8e18 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:09:15 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-5704ff30-fb85-4624-8bd6-298ccaca8e18 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:09:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5704ff30-fb85-4624-8bd6-298ccaca8e18 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5704ff30-fb85-4624-8bd6-298ccaca8e18 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5704ff30-fb85-4624-8bd6-298ccaca8e18 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5704ff30-fb85-4624-8bd6-298ccaca8e18 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5704ff30-fb85-4624-8bd6-298ccaca8e18 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5704ff30-fb85-4624-8bd6-298ccaca8e18 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:15 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-5704ff30-fb85-4624-8bd6-298ccaca8e18 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:09:15 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-5704ff30-fb85-4624-8bd6-298ccaca8e18 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1539 microversion: 2.1 time: 0.153577 Apr 13 23:09:15 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 262/773] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:09:15 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1539 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:09:16 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-093ed1d4-e48b-402c-9e75-b0ae84d48c4e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:09:16 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-093ed1d4-e48b-402c-9e75-b0ae84d48c4e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:09:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-093ed1d4-e48b-402c-9e75-b0ae84d48c4e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-093ed1d4-e48b-402c-9e75-b0ae84d48c4e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-093ed1d4-e48b-402c-9e75-b0ae84d48c4e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-093ed1d4-e48b-402c-9e75-b0ae84d48c4e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-093ed1d4-e48b-402c-9e75-b0ae84d48c4e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-093ed1d4-e48b-402c-9e75-b0ae84d48c4e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:16 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-093ed1d4-e48b-402c-9e75-b0ae84d48c4e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:09:16 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-093ed1d4-e48b-402c-9e75-b0ae84d48c4e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a9f5f1f-cc46-4c3c-834d-daa002031ee3" status: 200 len: 1440 microversion: 2.1 time: 0.153734 Apr 13 23:09:16 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 256/774] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:09:16 2023] GET /compute/v2.1/servers/1a9f5f1f-cc46-4c3c-834d-daa002031ee3 => generated 1440 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:09:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-e57bbe6b-2a54-4452-9015-45d6bf189ee4 req-97670725-8fe2-42fe-a0b9-548d755a5b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a9f5f1f-cc46-4c3c-834d-daa002031ee3", "tag": "e1ea4927-3d26-47cf-8db8-daa6fe358335"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:09:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e57bbe6b-2a54-4452-9015-45d6bf189ee4 req-97670725-8fe2-42fe-a0b9-548d755a5b9d service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e57bbe6b-2a54-4452-9015-45d6bf189ee4 req-97670725-8fe2-42fe-a0b9-548d755a5b9d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e57bbe6b-2a54-4452-9015-45d6bf189ee4 req-97670725-8fe2-42fe-a0b9-548d755a5b9d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:17 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-e57bbe6b-2a54-4452-9015-45d6bf189ee4 req-97670725-8fe2-42fe-a0b9-548d755a5b9d service nova] Creating event network-changed:e1ea4927-3d26-47cf-8db8-daa6fe358335 for instance 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 on user Apr 13 23:09:17 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-e57bbe6b-2a54-4452-9015-45d6bf189ee4 req-97670725-8fe2-42fe-a0b9-548d755a5b9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031337 Apr 13 23:09:17 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 257/775] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:09:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:09:18 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:09:18 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:09:18 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-5ebf2129-27c9-4864-b2c5-b5027efc1f04 req-7a190291-f9f4-415c-957c-1276fdbdbbdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a9f5f1f-cc46-4c3c-834d-daa002031ee3", "tag": "e1ea4927-3d26-47cf-8db8-daa6fe358335"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:09:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5ebf2129-27c9-4864-b2c5-b5027efc1f04 req-7a190291-f9f4-415c-957c-1276fdbdbbdd service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5ebf2129-27c9-4864-b2c5-b5027efc1f04 req-7a190291-f9f4-415c-957c-1276fdbdbbdd service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5ebf2129-27c9-4864-b2c5-b5027efc1f04 req-7a190291-f9f4-415c-957c-1276fdbdbbdd service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-5ebf2129-27c9-4864-b2c5-b5027efc1f04 req-7a190291-f9f4-415c-957c-1276fdbdbbdd service nova] Creating event network-changed:e1ea4927-3d26-47cf-8db8-daa6fe358335 for instance 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 on user Apr 13 23:09:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-5ebf2129-27c9-4864-b2c5-b5027efc1f04 req-7a190291-f9f4-415c-957c-1276fdbdbbdd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029211 Apr 13 23:09:18 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 257/776] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:09:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:09:18 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:09:18 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1a9f5f1f-cc46-4c3c-834d-daa002031ee3" status: 204 len: 0 microversion: 2.1 time: 0.117531 Apr 13 23:09:18 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 263/777] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:09:18 2023] DELETE /compute/v2.1/servers/1a9f5f1f-cc46-4c3c-834d-daa002031ee3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:09:18 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-0a129de6-6b96-4aa1-ac02-664bb529697b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:09:18 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-0a129de6-6b96-4aa1-ac02-664bb529697b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:09:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0a129de6-6b96-4aa1-ac02-664bb529697b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0a129de6-6b96-4aa1-ac02-664bb529697b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0a129de6-6b96-4aa1-ac02-664bb529697b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0a129de6-6b96-4aa1-ac02-664bb529697b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0a129de6-6b96-4aa1-ac02-664bb529697b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0a129de6-6b96-4aa1-ac02-664bb529697b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:18 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-0a129de6-6b96-4aa1-ac02-664bb529697b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:09:18 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-0a129de6-6b96-4aa1-ac02-664bb529697b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a9f5f1f-cc46-4c3c-834d-daa002031ee3" status: 200 len: 1564 microversion: 2.1 time: 0.188213 Apr 13 23:09:18 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 258/778] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:09:18 2023] GET /compute/v2.1/servers/1a9f5f1f-cc46-4c3c-834d-daa002031ee3 => generated 1564 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:09:20 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-05b8ddb7-bee2-4171-b763-0b9c3dd34e98 req-728b3fe4-b24f-4e7d-a8b5-c13e0ff9df47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a9f5f1f-cc46-4c3c-834d-daa002031ee3", "name": "network-vif-deleted", "tag": "e1ea4927-3d26-47cf-8db8-daa6fe358335"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:09:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-05b8ddb7-bee2-4171-b763-0b9c3dd34e98 req-728b3fe4-b24f-4e7d-a8b5-c13e0ff9df47 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-05b8ddb7-bee2-4171-b763-0b9c3dd34e98 req-728b3fe4-b24f-4e7d-a8b5-c13e0ff9df47 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-05b8ddb7-bee2-4171-b763-0b9c3dd34e98 req-728b3fe4-b24f-4e7d-a8b5-c13e0ff9df47 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:20 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-05b8ddb7-bee2-4171-b763-0b9c3dd34e98 req-728b3fe4-b24f-4e7d-a8b5-c13e0ff9df47 service nova] Creating event network-vif-deleted:e1ea4927-3d26-47cf-8db8-daa6fe358335 for instance 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 on user Apr 13 23:09:20 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-05b8ddb7-bee2-4171-b763-0b9c3dd34e98 req-728b3fe4-b24f-4e7d-a8b5-c13e0ff9df47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072062 Apr 13 23:09:20 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 258/779] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:09:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:09:20 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-802df950-70f8-4ebb-9941-eb25a066a1a7 req-c32e3727-9afd-4c5a-a012-eb0c2ac2dffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a9f5f1f-cc46-4c3c-834d-daa002031ee3", "name": "network-vif-unplugged", "status": "completed", "tag": "e1ea4927-3d26-47cf-8db8-daa6fe358335"}, {"server_uuid": "1a9f5f1f-cc46-4c3c-834d-daa002031ee3", "name": "network-vif-plugged", "status": "completed", "tag": "e1ea4927-3d26-47cf-8db8-daa6fe358335"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:09:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-802df950-70f8-4ebb-9941-eb25a066a1a7 req-c32e3727-9afd-4c5a-a012-eb0c2ac2dffc service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-802df950-70f8-4ebb-9941-eb25a066a1a7 req-c32e3727-9afd-4c5a-a012-eb0c2ac2dffc service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-802df950-70f8-4ebb-9941-eb25a066a1a7 req-c32e3727-9afd-4c5a-a012-eb0c2ac2dffc service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:20 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-802df950-70f8-4ebb-9941-eb25a066a1a7 req-c32e3727-9afd-4c5a-a012-eb0c2ac2dffc service nova] Creating event network-vif-unplugged:e1ea4927-3d26-47cf-8db8-daa6fe358335 for instance 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 on user Apr 13 23:09:20 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-802df950-70f8-4ebb-9941-eb25a066a1a7 req-c32e3727-9afd-4c5a-a012-eb0c2ac2dffc service nova] Creating event network-vif-plugged:e1ea4927-3d26-47cf-8db8-daa6fe358335 for instance 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 on user Apr 13 23:09:20 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-802df950-70f8-4ebb-9941-eb25a066a1a7 req-c32e3727-9afd-4c5a-a012-eb0c2ac2dffc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.029100 Apr 13 23:09:20 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 264/780] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:09:20 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:09:52 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-dff9ca50-1a6c-46ff-b02a-51a8806c4f88 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1554490643", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "destination_type": "local"}, {"source_type": "volume", "uuid": "b8294ec9-3ea0-4d12-b010-060263cd22cb", "destination_type": "invalid"}], "networks": [{"uuid": "767f78e8-a875-44f4-bb0d-64565b88a59d"}]}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:09:52 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-dff9ca50-1a6c-46ff-b02a-51a8806c4f88 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Request method failure captured: Apr 13 23:09:52 user devstack@n-api.service[61612]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 13 23:09:52 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:09:52 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:09:52 user devstack@n-api.service[61612]: Connection: close Apr 13 23:09:52 user devstack@n-api.service[61612]: Content-Length: 494 Apr 13 23:09:52 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:09:52 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:09:52 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:09:52 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:09:52 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIn1WpkCHTcQ3vsm6vuXvLMwBukWR3T78fUteB1g1zobAkavXEwqiMsjm9a7O1wQSAPbhSneJ4g36HRneth-jvcWNhT4bg4W3DOs07jcjQHnm6EdcnPlV6wX56fpXkxsD2Vss9a8TpT8oI4bKWdzWDXg8gRXoxb6iO_eerJkHkQeHrY Apr 13 23:09:52 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:09:52 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:09:52 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:09:52 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:09:52 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:09:52 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:09:52 user devstack@n-api.service[61612]: X-Project-Id: d8a3c684b0414336b2ca770eb1f3ab17 Apr 13 23:09:52 user devstack@n-api.service[61612]: X-Project-Name: tempest-ServersNegativeTestJSON-1433854176 Apr 13 23:09:52 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:09:52 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:09:52 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d8a3c684b0414336b2ca770eb1f3ab17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8a3c684b0414336b2ca770eb1f3ab17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8a3c684b0414336b2ca770eb1f3ab17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:09:52 user devstack@n-api.service[61612]: X-Tenant: tempest-ServersNegativeTestJSON-1433854176 Apr 13 23:09:52 user devstack@n-api.service[61612]: X-Tenant-Id: d8a3c684b0414336b2ca770eb1f3ab17 Apr 13 23:09:52 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1433854176 Apr 13 23:09:52 user devstack@n-api.service[61612]: X-User: tempest-ServersNegativeTestJSON-1433854176-project-member Apr 13 23:09:52 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:09:52 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:09:52 user devstack@n-api.service[61612]: X-User-Id: 71593deacbd74fea9fc2faf5a9b08877 Apr 13 23:09:52 user devstack@n-api.service[61612]: X-User-Name: tempest-ServersNegativeTestJSON-1433854176-project-member Apr 13 23:09:52 user devstack@n-api.service[61612]: Apr 13 23:09:52 user devstack@n-api.service[61612]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1554490643", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "destination_type": "local"}, {"source_type": "volume", "uuid": "b8294ec9-3ea0-4d12-b010-060263cd22cb", "destination_type": "invalid"}], "networks": [{"uuid": "767f78e8-a875-44f4-bb0d-64565b88a59d"}]}} Apr 13 23:09:52 user devstack@n-api.service[61612]: method: > Apr 13 23:09:52 user devstack@n-api.service[61612]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 23:09:52 user devstack@n-api.service[61612]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1554490643', 'imageRef': 'd6970ace-53c3-48ed-ae08-e4c3846a312a', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'd6970ace-53c3-48ed-ae08-e4c3846a312a', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'b8294ec9-3ea0-4d12-b010-060263cd22cb', 'destination_type': 'invalid'}], 'networks': [{'uuid': '767f78e8-a875-44f4-bb0d-64565b88a59d'}]}}} Apr 13 23:09:52 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise error Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi 'invalid' Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 23:09:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:09:52 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-dff9ca50-1a6c-46ff-b02a-51a8806c4f88 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:09:52 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-dff9ca50-1a6c-46ff-b02a-51a8806c4f88 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.010195 Apr 13 23:09:52 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 259/781] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:09:52 2023] POST /compute/v2.1/servers => generated 155 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:09:52 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=8 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:09:52 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=16 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:09:52 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-186faed9-2b2f-41a0-8fb4-93b46316ea25 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:09:52 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-186faed9-2b2f-41a0-8fb4-93b46316ea25 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:09:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-186faed9-2b2f-41a0-8fb4-93b46316ea25 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-186faed9-2b2f-41a0-8fb4-93b46316ea25 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-186faed9-2b2f-41a0-8fb4-93b46316ea25 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-186faed9-2b2f-41a0-8fb4-93b46316ea25 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-186faed9-2b2f-41a0-8fb4-93b46316ea25 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-186faed9-2b2f-41a0-8fb4-93b46316ea25 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:52 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-186faed9-2b2f-41a0-8fb4-93b46316ea25 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71593deacbd74fea9fc2faf5a9b08877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a3c684b0414336b2ca770eb1f3ab17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:09:52 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-186faed9-2b2f-41a0-8fb4-93b46316ea25 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc473fb8-e574-4e49-b860-3ae0066cc9b8" status: 200 len: 1491 microversion: 2.1 time: 0.313147 Apr 13 23:09:52 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 259/782] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:09:52 2023] GET /compute/v2.1/servers/dc473fb8-e574-4e49-b860-3ae0066cc9b8 => generated 1491 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:09:53 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:09:53 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:09:53 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "0d358831-cd5e-4bbe-98f2-c0c289b7851e"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:09:53 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:09:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=8 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=18 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:09:53 user devstack@n-api.service[61613]: DEBUG nova.objects.instance [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'flavor' on Instance uuid a9e9744c-04d3-486e-b032-90c672927962 {{(pid=61613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-a89f474a-45ee-4f66-b3df-44ad7103c397 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-a89f474a-45ee-4f66-b3df-44ad7103c397 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a89f474a-45ee-4f66-b3df-44ad7103c397 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a89f474a-45ee-4f66-b3df-44ad7103c397 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a89f474a-45ee-4f66-b3df-44ad7103c397 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a89f474a-45ee-4f66-b3df-44ad7103c397 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a89f474a-45ee-4f66-b3df-44ad7103c397 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a89f474a-45ee-4f66-b3df-44ad7103c397 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:53 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-a89f474a-45ee-4f66-b3df-44ad7103c397 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] HTTP exception thrown: Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 could not be found. Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-a89f474a-45ee-4f66-b3df-44ad7103c397 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Request method failure captured: Apr 13 23:09:53 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/ff417f05-3cfa-4274-a0d9-9145ce1e5f83 HTTP/1.1 Apr 13 23:09:53 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:09:53 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:09:53 user devstack@n-api.service[61612]: Connection: close Apr 13 23:09:53 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:09:53 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:09:53 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:09:53 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:09:53 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:09:53 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIfHQxdyZtX-iu-ThNLEChPZxANikiWLMMCIRZ25gQuq3VxddslsqUB5ikMLZ2ePv4vTU-JsJ6azIW7Ww-AQ-OdqvQt7Sws4Wi7PO44E5yqLWKj1QiMLUT5MdNcavqRLksBSt368wMT-Wgo0vOgAq25fxnYJ3kH5oYJcbmhrlbtbUaQ Apr 13 23:09:53 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:09:53 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:09:53 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:09:53 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:09:53 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:09:53 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:09:53 user devstack@n-api.service[61612]: X-Project-Id: 5b6a1fccc07f4f5a8f8f8617ae03955d Apr 13 23:09:53 user devstack@n-api.service[61612]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-258614246 Apr 13 23:09:53 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:09:53 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:09:53 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5b6a1fccc07f4f5a8f8f8617ae03955d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b6a1fccc07f4f5a8f8f8617ae03955d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b6a1fccc07f4f5a8f8f8617ae03955d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:09:53 user devstack@n-api.service[61612]: X-Tenant: tempest-ServerRescueNegativeTestJSON-258614246 Apr 13 23:09:53 user devstack@n-api.service[61612]: X-Tenant-Id: 5b6a1fccc07f4f5a8f8f8617ae03955d Apr 13 23:09:53 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-258614246 Apr 13 23:09:53 user devstack@n-api.service[61612]: X-User: tempest-ServerRescueNegativeTestJSON-258614246-project-member Apr 13 23:09:53 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:09:53 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:09:53 user devstack@n-api.service[61612]: X-User-Id: 28cb6d8d6e3d4ef7aa53bb17faf495c4 Apr 13 23:09:53 user devstack@n-api.service[61612]: X-User-Name: tempest-ServerRescueNegativeTestJSON-258614246-project-member Apr 13 23:09:53 user devstack@n-api.service[61612]: method: > Apr 13 23:09:53 user devstack@n-api.service[61612]: exception: Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 could not be found. Apr 13 23:09:53 user devstack@n-api.service[61612]: action_args: {'id': 'ff417f05-3cfa-4274-a0d9-9145ce1e5f83'} Apr 13 23:09:53 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 could not be found. Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 could not be found. Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 could not be found. Apr 13 23:09:53 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-a89f474a-45ee-4f66-b3df-44ad7103c397 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Returning 404 to user: Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:09:53 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-a89f474a-45ee-4f66-b3df-44ad7103c397 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff417f05-3cfa-4274-a0d9-9145ce1e5f83" status: 404 len: 111 microversion: 2.1 time: 0.207312 Apr 13 23:09:53 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 260/783] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:09:53 2023] GET /compute/v2.1/servers/ff417f05-3cfa-4274-a0d9-9145ce1e5f83 => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:09:53 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:09:53 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:09:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:53 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:09:53 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555" status: 204 len: 0 microversion: 2.1 time: 0.125818 Apr 13 23:09:53 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 260/784] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:09:53 2023] DELETE /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-b4c8e9ae-9d33-4c4e-b775-26f5ac332ae2 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-b4c8e9ae-9d33-4c4e-b775-26f5ac332ae2 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b4c8e9ae-9d33-4c4e-b775-26f5ac332ae2 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b4c8e9ae-9d33-4c4e-b775-26f5ac332ae2 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b4c8e9ae-9d33-4c4e-b775-26f5ac332ae2 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b4c8e9ae-9d33-4c4e-b775-26f5ac332ae2 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b4c8e9ae-9d33-4c4e-b775-26f5ac332ae2 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b4c8e9ae-9d33-4c4e-b775-26f5ac332ae2 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-b4c8e9ae-9d33-4c4e-b775-26f5ac332ae2 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:09:53 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-b4c8e9ae-9d33-4c4e-b775-26f5ac332ae2 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555" status: 200 len: 1511 microversion: 2.1 time: 0.204196 Apr 13 23:09:53 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 261/785] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:09:53 2023] GET /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555 => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:09:53 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-1ac4e638-0a46-44e9-b0ed-304a87fa27c1 req-893b11a7-6c33-49e8-bc6f-e6c4459819f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df12dd8d-ea02-4c59-804d-52ae1bd4a555", "name": "network-vif-unplugged", "status": "completed", "tag": "6566345e-be68-4eb1-90de-e53780e7f8f9"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:09:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-1ac4e638-0a46-44e9-b0ed-304a87fa27c1 req-893b11a7-6c33-49e8-bc6f-e6c4459819f4 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-1ac4e638-0a46-44e9-b0ed-304a87fa27c1 req-893b11a7-6c33-49e8-bc6f-e6c4459819f4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-1ac4e638-0a46-44e9-b0ed-304a87fa27c1 req-893b11a7-6c33-49e8-bc6f-e6c4459819f4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:53 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-1ac4e638-0a46-44e9-b0ed-304a87fa27c1 req-893b11a7-6c33-49e8-bc6f-e6c4459819f4 service nova] Creating event network-vif-unplugged:6566345e-be68-4eb1-90de-e53780e7f8f9 for instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 on user Apr 13 23:09:53 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-1ac4e638-0a46-44e9-b0ed-304a87fa27c1 req-893b11a7-6c33-49e8-bc6f-e6c4459819f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091987 Apr 13 23:09:53 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 261/786] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:09:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:09:53 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962/action" status: 200 len: 29 microversion: 2.87 time: 0.828132 Apr 13 23:09:53 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 265/787] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 23:09:53 2023] POST /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962/action => generated 29 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-3bd607bd-eafc-4f16-9e27-21ca395df7a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-3bd607bd-eafc-4f16-9e27-21ca395df7a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3bd607bd-eafc-4f16-9e27-21ca395df7a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3bd607bd-eafc-4f16-9e27-21ca395df7a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3bd607bd-eafc-4f16-9e27-21ca395df7a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3bd607bd-eafc-4f16-9e27-21ca395df7a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3bd607bd-eafc-4f16-9e27-21ca395df7a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3bd607bd-eafc-4f16-9e27-21ca395df7a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:54 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-3bd607bd-eafc-4f16-9e27-21ca395df7a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:09:54 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-3bd607bd-eafc-4f16-9e27-21ca395df7a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:09:54 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-3bd607bd-eafc-4f16-9e27-21ca395df7a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:09:54 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-3bd607bd-eafc-4f16-9e27-21ca395df7a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962" status: 200 len: 1774 microversion: 2.87 time: 0.185554 Apr 13 23:09:54 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 262/788] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:09:53 2023] GET /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962 => generated 1774 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:09:54 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5d2841b1-023f-457f-9387-f0cd36081256 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:09:54 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-5d2841b1-023f-457f-9387-f0cd36081256 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:09:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5d2841b1-023f-457f-9387-f0cd36081256 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5d2841b1-023f-457f-9387-f0cd36081256 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5d2841b1-023f-457f-9387-f0cd36081256 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5d2841b1-023f-457f-9387-f0cd36081256 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5d2841b1-023f-457f-9387-f0cd36081256 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5d2841b1-023f-457f-9387-f0cd36081256 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:54 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-5d2841b1-023f-457f-9387-f0cd36081256 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] HTTP exception thrown: Instance 392704a5-705a-43d0-bab8-801c7ef5b514 could not be found. Apr 13 23:09:54 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5d2841b1-023f-457f-9387-f0cd36081256 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Request method failure captured: Apr 13 23:09:54 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/392704a5-705a-43d0-bab8-801c7ef5b514 HTTP/1.1 Apr 13 23:09:54 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:09:54 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:09:54 user devstack@n-api.service[61611]: Connection: close Apr 13 23:09:54 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:09:54 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:09:54 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:09:54 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:09:54 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:09:54 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIsX9IAyxlWBdQy_VkdbVa3OR5tv4IiujAK_Grb6iuhv0FkmbVpi1-DVGSBa61Ri1c2L8Ifk-g3WzbnBKgnc3UxK1eBnf3MFO60zl-8mifb_FyRmOUdNHkX2vJbWsSKH6MEegw-KygrRJGykQobKbsTnMbF1cQ2WXktJZ7pIE8PKwbg Apr 13 23:09:54 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:09:54 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:09:54 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:09:54 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:09:54 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:09:54 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:09:54 user devstack@n-api.service[61611]: X-Project-Id: 12ecbdf826b849bf995787ada9d4a673 Apr 13 23:09:54 user devstack@n-api.service[61611]: X-Project-Name: tempest-VolumesActionsTest-1315360402 Apr 13 23:09:54 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:09:54 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:09:54 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/12ecbdf826b849bf995787ada9d4a673"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12ecbdf826b849bf995787ada9d4a673"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12ecbdf826b849bf995787ada9d4a673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:09:54 user devstack@n-api.service[61611]: X-Tenant: tempest-VolumesActionsTest-1315360402 Apr 13 23:09:54 user devstack@n-api.service[61611]: X-Tenant-Id: 12ecbdf826b849bf995787ada9d4a673 Apr 13 23:09:54 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-VolumesActionsTest-1315360402 Apr 13 23:09:54 user devstack@n-api.service[61611]: X-User: tempest-VolumesActionsTest-1315360402-project-member Apr 13 23:09:54 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:09:54 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:09:54 user devstack@n-api.service[61611]: X-User-Id: 1114619485574b9499b5384a9529003f Apr 13 23:09:54 user devstack@n-api.service[61611]: X-User-Name: tempest-VolumesActionsTest-1315360402-project-member Apr 13 23:09:54 user devstack@n-api.service[61611]: method: > Apr 13 23:09:54 user devstack@n-api.service[61611]: exception: Instance 392704a5-705a-43d0-bab8-801c7ef5b514 could not be found. Apr 13 23:09:54 user devstack@n-api.service[61611]: action_args: {'id': '392704a5-705a-43d0-bab8-801c7ef5b514'} Apr 13 23:09:54 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 392704a5-705a-43d0-bab8-801c7ef5b514 could not be found. Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 392704a5-705a-43d0-bab8-801c7ef5b514 could not be found. Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 392704a5-705a-43d0-bab8-801c7ef5b514 could not be found. Apr 13 23:09:54 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:09:54 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5d2841b1-023f-457f-9387-f0cd36081256 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Returning 404 to user: Instance 392704a5-705a-43d0-bab8-801c7ef5b514 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:09:54 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-5d2841b1-023f-457f-9387-f0cd36081256 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] 10.0.0.210 "GET /compute/v2.1/servers/392704a5-705a-43d0-bab8-801c7ef5b514" status: 404 len: 111 microversion: 2.1 time: 0.041699 Apr 13 23:09:54 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 262/789] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:09:54 2023] GET /compute/v2.1/servers/392704a5-705a-43d0-bab8-801c7ef5b514 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:09:54 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-c136caf1-0068-4d4d-a485-2edaac1371d8 req-b91adb7a-5223-42f7-b6b2-97c31df2da92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df12dd8d-ea02-4c59-804d-52ae1bd4a555", "name": "network-vif-deleted", "tag": "6566345e-be68-4eb1-90de-e53780e7f8f9"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:09:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c136caf1-0068-4d4d-a485-2edaac1371d8 req-b91adb7a-5223-42f7-b6b2-97c31df2da92 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c136caf1-0068-4d4d-a485-2edaac1371d8 req-b91adb7a-5223-42f7-b6b2-97c31df2da92 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c136caf1-0068-4d4d-a485-2edaac1371d8 req-b91adb7a-5223-42f7-b6b2-97c31df2da92 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:54 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-c136caf1-0068-4d4d-a485-2edaac1371d8 req-b91adb7a-5223-42f7-b6b2-97c31df2da92 service nova] Creating event network-vif-deleted:6566345e-be68-4eb1-90de-e53780e7f8f9 for instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 on user Apr 13 23:09:54 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-c136caf1-0068-4d4d-a485-2edaac1371d8 req-b91adb7a-5223-42f7-b6b2-97c31df2da92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028763 Apr 13 23:09:54 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 266/790] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:09:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:09:55 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df12dd8d-ea02-4c59-804d-52ae1bd4a555", "name": "network-vif-plugged", "status": "completed", "tag": "6566345e-be68-4eb1-90de-e53780e7f8f9"}, {"server_uuid": "a9e9744c-04d3-486e-b032-90c672927962", "name": "network-vif-unplugged", "status": "completed", "tag": "7ae6b103-e1c6-42e6-9fcd-e76353955a76"}, {"server_uuid": "a9e9744c-04d3-486e-b032-90c672927962", "name": "network-vif-plugged", "status": "completed", "tag": "7ae6b103-e1c6-42e6-9fcd-e76353955a76"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:09:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:55 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] Creating event network-vif-plugged:6566345e-be68-4eb1-90de-e53780e7f8f9 for instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 on user Apr 13 23:09:55 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] Creating event network-vif-unplugged:7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance a9e9744c-04d3-486e-b032-90c672927962 on user Apr 13 23:09:55 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] Creating event network-vif-plugged:7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance a9e9744c-04d3-486e-b032-90c672927962 on user Apr 13 23:09:55 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.032095 Apr 13 23:09:55 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 263/791] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:09:55 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:09:59 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-445b2ff5-b2c3-4fe9-86a6-c46f652aa716 req-c8a3db27-6ef7-4155-ab19-69b3f676630e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e9744c-04d3-486e-b032-90c672927962", "name": "network-vif-plugged", "status": "completed", "tag": "7ae6b103-e1c6-42e6-9fcd-e76353955a76"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:09:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-445b2ff5-b2c3-4fe9-86a6-c46f652aa716 req-c8a3db27-6ef7-4155-ab19-69b3f676630e service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:09:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-445b2ff5-b2c3-4fe9-86a6-c46f652aa716 req-c8a3db27-6ef7-4155-ab19-69b3f676630e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:09:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-445b2ff5-b2c3-4fe9-86a6-c46f652aa716 req-c8a3db27-6ef7-4155-ab19-69b3f676630e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:09:59 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-445b2ff5-b2c3-4fe9-86a6-c46f652aa716 req-c8a3db27-6ef7-4155-ab19-69b3f676630e service nova] Creating event network-vif-plugged:7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance a9e9744c-04d3-486e-b032-90c672927962 on user Apr 13 23:09:59 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-445b2ff5-b2c3-4fe9-86a6-c46f652aa716 req-c8a3db27-6ef7-4155-ab19-69b3f676630e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030631 Apr 13 23:09:59 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 263/792] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:09:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:10:01 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-3c081963-9065-4a63-a574-d3e5f8a5d9a1 req-782a532d-1653-4e96-a7c0-7722641f278e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e9744c-04d3-486e-b032-90c672927962", "name": "network-vif-plugged", "status": "completed", "tag": "7ae6b103-e1c6-42e6-9fcd-e76353955a76"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:10:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3c081963-9065-4a63-a574-d3e5f8a5d9a1 req-782a532d-1653-4e96-a7c0-7722641f278e service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3c081963-9065-4a63-a574-d3e5f8a5d9a1 req-782a532d-1653-4e96-a7c0-7722641f278e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3c081963-9065-4a63-a574-d3e5f8a5d9a1 req-782a532d-1653-4e96-a7c0-7722641f278e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:01 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-3c081963-9065-4a63-a574-d3e5f8a5d9a1 req-782a532d-1653-4e96-a7c0-7722641f278e service nova] Creating event network-vif-plugged:7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance a9e9744c-04d3-486e-b032-90c672927962 on user Apr 13 23:10:01 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-3c081963-9065-4a63-a574-d3e5f8a5d9a1 req-782a532d-1653-4e96-a7c0-7722641f278e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029547 Apr 13 23:10:01 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 267/793] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:10:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:10:05 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=10 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:10:05 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=16 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:10:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-65abb739-12d8-4315-8bb2-bb1647003c40 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:05 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-65abb739-12d8-4315-8bb2-bb1647003c40 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:10:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-65abb739-12d8-4315-8bb2-bb1647003c40 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-65abb739-12d8-4315-8bb2-bb1647003c40 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-65abb739-12d8-4315-8bb2-bb1647003c40 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-65abb739-12d8-4315-8bb2-bb1647003c40 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-65abb739-12d8-4315-8bb2-bb1647003c40 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-65abb739-12d8-4315-8bb2-bb1647003c40 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:06 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-65abb739-12d8-4315-8bb2-bb1647003c40 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:10:06 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-65abb739-12d8-4315-8bb2-bb1647003c40 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1657 microversion: 2.1 time: 0.181905 Apr 13 23:10:06 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 264/794] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:10:05 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1657 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:10:06 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d5325a05-65c8-4b18-901f-2c53c80942e3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:06 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-d5325a05-65c8-4b18-901f-2c53c80942e3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:10:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d5325a05-65c8-4b18-901f-2c53c80942e3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d5325a05-65c8-4b18-901f-2c53c80942e3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d5325a05-65c8-4b18-901f-2c53c80942e3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d5325a05-65c8-4b18-901f-2c53c80942e3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d5325a05-65c8-4b18-901f-2c53c80942e3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d5325a05-65c8-4b18-901f-2c53c80942e3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:06 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-d5325a05-65c8-4b18-901f-2c53c80942e3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:10:06 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-d5325a05-65c8-4b18-901f-2c53c80942e3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1657 microversion: 2.1 time: 0.172023 Apr 13 23:10:06 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 264/795] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:10:06 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1657 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:10:08 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-08f11450-f41f-4f96-8a78-7ee647f9c954 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:08 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-08f11450-f41f-4f96-8a78-7ee647f9c954 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:10:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-08f11450-f41f-4f96-8a78-7ee647f9c954 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-08f11450-f41f-4f96-8a78-7ee647f9c954 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-08f11450-f41f-4f96-8a78-7ee647f9c954 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-08f11450-f41f-4f96-8a78-7ee647f9c954 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-08f11450-f41f-4f96-8a78-7ee647f9c954 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-08f11450-f41f-4f96-8a78-7ee647f9c954 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:09 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-08f11450-f41f-4f96-8a78-7ee647f9c954 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] HTTP exception thrown: Instance 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 could not be found. Apr 13 23:10:09 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-08f11450-f41f-4f96-8a78-7ee647f9c954 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Request method failure captured: Apr 13 23:10:09 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/1a9f5f1f-cc46-4c3c-834d-daa002031ee3 HTTP/1.1 Apr 13 23:10:09 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:10:09 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:10:09 user devstack@n-api.service[61613]: Connection: close Apr 13 23:10:09 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:10:09 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:10:09 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:10:09 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:10:09 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:10:09 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIgE6Gl7ZSFkA-_Uvg9_1wPLldz_ScwHJLtH7XfCRP3AC2MJmMpZ7l9bcSBPK09rKumFcFKFuRTWt2Sf1d4N5k3NQaJGxn8JzsH44PLD5fzCs7WE6phnuUwwFlbCj4pm_qJgudGzAbO1tRiQjdcyEvfY3Ke0cXzXFHfEZxyouzAaMTk Apr 13 23:10:09 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:10:09 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:10:09 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:10:09 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:10:09 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:10:09 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:10:09 user devstack@n-api.service[61613]: X-Project-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:10:09 user devstack@n-api.service[61613]: X-Project-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:10:09 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:10:09 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:10:09 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:10:09 user devstack@n-api.service[61613]: X-Tenant: tempest-TestVolumeBootPattern-751187467 Apr 13 23:10:09 user devstack@n-api.service[61613]: X-Tenant-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:10:09 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:10:09 user devstack@n-api.service[61613]: X-User: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:10:09 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:10:09 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:10:09 user devstack@n-api.service[61613]: X-User-Id: b289294050af4c41aeef8401832487a1 Apr 13 23:10:09 user devstack@n-api.service[61613]: X-User-Name: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:10:09 user devstack@n-api.service[61613]: method: > Apr 13 23:10:09 user devstack@n-api.service[61613]: exception: Instance 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 could not be found. Apr 13 23:10:09 user devstack@n-api.service[61613]: action_args: {'id': '1a9f5f1f-cc46-4c3c-834d-daa002031ee3'} Apr 13 23:10:09 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 could not be found. Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 could not be found. Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 could not be found. Apr 13 23:10:09 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:10:09 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-08f11450-f41f-4f96-8a78-7ee647f9c954 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Returning 404 to user: Instance 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:10:09 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-08f11450-f41f-4f96-8a78-7ee647f9c954 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a9f5f1f-cc46-4c3c-834d-daa002031ee3" status: 404 len: 111 microversion: 2.1 time: 0.233016 Apr 13 23:10:09 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 268/796] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:10:08 2023] GET /compute/v2.1/servers/1a9f5f1f-cc46-4c3c-834d-daa002031ee3 => generated 111 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:10:15 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:15 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:10:15 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:10:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:16 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Going to try to terminate instance {{(pid=61612) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:10:16 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d3dc82c4-502a-4ff9-a230-129269f5c0e6" status: 204 len: 0 microversion: 2.1 time: 0.148131 Apr 13 23:10:16 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 265/797] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:10:15 2023] DELETE /compute/v2.1/servers/d3dc82c4-502a-4ff9-a230-129269f5c0e6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:10:16 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-4b0fa8d0-c911-47a2-9637-ad6859b7866c tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:16 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-4b0fa8d0-c911-47a2-9637-ad6859b7866c tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:10:16 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:10:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4b0fa8d0-c911-47a2-9637-ad6859b7866c tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4b0fa8d0-c911-47a2-9637-ad6859b7866c tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4b0fa8d0-c911-47a2-9637-ad6859b7866c tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4b0fa8d0-c911-47a2-9637-ad6859b7866c tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4b0fa8d0-c911-47a2-9637-ad6859b7866c tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4b0fa8d0-c911-47a2-9637-ad6859b7866c tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:16 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:16 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:10:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:16 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-39839dde-39e3-49a9-9abc-92dfb97f2224 req-dafde1d5-5271-4e8b-80d2-877006685053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a83b839-7b5b-4004-94da-d196d18caf0f", "tag": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:10:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-39839dde-39e3-49a9-9abc-92dfb97f2224 req-dafde1d5-5271-4e8b-80d2-877006685053 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-39839dde-39e3-49a9-9abc-92dfb97f2224 req-dafde1d5-5271-4e8b-80d2-877006685053 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-39839dde-39e3-49a9-9abc-92dfb97f2224 req-dafde1d5-5271-4e8b-80d2-877006685053 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:16 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-39839dde-39e3-49a9-9abc-92dfb97f2224 req-dafde1d5-5271-4e8b-80d2-877006685053 service nova] Creating event network-changed:a88bc4ee-b024-4d26-9e56-e60daf6ef5fa for instance 1a83b839-7b5b-4004-94da-d196d18caf0f on user Apr 13 23:10:16 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-39839dde-39e3-49a9-9abc-92dfb97f2224 req-dafde1d5-5271-4e8b-80d2-877006685053 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039860 Apr 13 23:10:16 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 266/798] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:10:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 23:10:16 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:10:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1a83b839-7b5b-4004-94da-d196d18caf0f" status: 204 len: 0 microversion: 2.1 time: 0.163366 Apr 13 23:10:16 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 269/799] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:10:16 2023] DELETE /compute/v2.1/servers/1a83b839-7b5b-4004-94da-d196d18caf0f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:10:16 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-12b8aa0f-a138-43c9-8ca7-4063463ade53 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:16 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-12b8aa0f-a138-43c9-8ca7-4063463ade53 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:10:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-12b8aa0f-a138-43c9-8ca7-4063463ade53 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-12b8aa0f-a138-43c9-8ca7-4063463ade53 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-12b8aa0f-a138-43c9-8ca7-4063463ade53 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-12b8aa0f-a138-43c9-8ca7-4063463ade53 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-12b8aa0f-a138-43c9-8ca7-4063463ade53 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-12b8aa0f-a138-43c9-8ca7-4063463ade53 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:16 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-4b0fa8d0-c911-47a2-9637-ad6859b7866c tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c235879bc444a819061c4bb4bf3441b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6455f36704e4b3088d8a9114b087fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:10:16 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-4b0fa8d0-c911-47a2-9637-ad6859b7866c tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3dc82c4-502a-4ff9-a230-129269f5c0e6" status: 200 len: 1490 microversion: 2.1 time: 0.279595 Apr 13 23:10:16 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 265/800] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:10:16 2023] GET /compute/v2.1/servers/d3dc82c4-502a-4ff9-a230-129269f5c0e6 => generated 1490 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:10:16 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-12b8aa0f-a138-43c9-8ca7-4063463ade53 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:10:16 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-12b8aa0f-a138-43c9-8ca7-4063463ade53 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a83b839-7b5b-4004-94da-d196d18caf0f" status: 200 len: 1565 microversion: 2.1 time: 0.257586 Apr 13 23:10:16 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 267/801] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:10:16 2023] GET /compute/v2.1/servers/1a83b839-7b5b-4004-94da-d196d18caf0f => generated 1565 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 23:10:18 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3dc82c4-502a-4ff9-a230-129269f5c0e6", "name": "network-vif-unplugged", "status": "completed", "tag": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23"}, {"server_uuid": "d3dc82c4-502a-4ff9-a230-129269f5c0e6", "name": "network-vif-plugged", "status": "completed", "tag": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23"}, {"server_uuid": "1a83b839-7b5b-4004-94da-d196d18caf0f", "name": "network-vif-unplugged", "status": "completed", "tag": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa"}, {"server_uuid": "1a83b839-7b5b-4004-94da-d196d18caf0f", "name": "network-vif-plugged", "status": "completed", "tag": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa"}, {"server_uuid": "1a83b839-7b5b-4004-94da-d196d18caf0f", "name": "network-vif-plugged", "status": "completed", "tag": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa"}, {"server_uuid": "1a83b839-7b5b-4004-94da-d196d18caf0f", "name": "network-vif-plugged", "status": "completed", "tag": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa"}, {"server_uuid": "1a83b839-7b5b-4004-94da-d196d18caf0f", "name": "network-vif-unplugged", "status": "completed", "tag": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:10:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:18 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Creating event network-vif-unplugged:b572f64e-cfdf-4d37-8ac3-6776b86a2c23 for instance d3dc82c4-502a-4ff9-a230-129269f5c0e6 on user Apr 13 23:10:18 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Creating event network-vif-plugged:b572f64e-cfdf-4d37-8ac3-6776b86a2c23 for instance d3dc82c4-502a-4ff9-a230-129269f5c0e6 on user Apr 13 23:10:18 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Creating event network-vif-unplugged:a88bc4ee-b024-4d26-9e56-e60daf6ef5fa for instance 1a83b839-7b5b-4004-94da-d196d18caf0f on user Apr 13 23:10:18 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Creating event network-vif-plugged:a88bc4ee-b024-4d26-9e56-e60daf6ef5fa for instance 1a83b839-7b5b-4004-94da-d196d18caf0f on user Apr 13 23:10:18 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Creating event network-vif-plugged:a88bc4ee-b024-4d26-9e56-e60daf6ef5fa for instance 1a83b839-7b5b-4004-94da-d196d18caf0f on user Apr 13 23:10:18 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Creating event network-vif-plugged:a88bc4ee-b024-4d26-9e56-e60daf6ef5fa for instance 1a83b839-7b5b-4004-94da-d196d18caf0f on user Apr 13 23:10:18 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Creating event network-vif-unplugged:a88bc4ee-b024-4d26-9e56-e60daf6ef5fa for instance 1a83b839-7b5b-4004-94da-d196d18caf0f on user Apr 13 23:10:18 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.038847 Apr 13 23:10:18 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 270/802] 10.0.0.210 () {68 vars in 1395 bytes} [Thu Apr 13 23:10:18 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:10:18 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-796324d7-5824-46ca-9db1-54337cf5d84e req-e914db75-e35c-4e3c-933d-d2d43ecde30e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3dc82c4-502a-4ff9-a230-129269f5c0e6", "name": "network-vif-deleted", "tag": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:10:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-796324d7-5824-46ca-9db1-54337cf5d84e req-e914db75-e35c-4e3c-933d-d2d43ecde30e service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-796324d7-5824-46ca-9db1-54337cf5d84e req-e914db75-e35c-4e3c-933d-d2d43ecde30e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-796324d7-5824-46ca-9db1-54337cf5d84e req-e914db75-e35c-4e3c-933d-d2d43ecde30e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-796324d7-5824-46ca-9db1-54337cf5d84e req-e914db75-e35c-4e3c-933d-d2d43ecde30e service nova] Creating event network-vif-deleted:b572f64e-cfdf-4d37-8ac3-6776b86a2c23 for instance d3dc82c4-502a-4ff9-a230-129269f5c0e6 on user Apr 13 23:10:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-796324d7-5824-46ca-9db1-54337cf5d84e req-e914db75-e35c-4e3c-933d-d2d43ecde30e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030086 Apr 13 23:10:18 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 266/803] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:10:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:10:20 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-10099b3e-30dc-4fcb-b6c3-85307c135344 req-26787509-1088-4bc2-9976-3435f2a52740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a83b839-7b5b-4004-94da-d196d18caf0f", "name": "network-vif-plugged", "status": "completed", "tag": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:10:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-10099b3e-30dc-4fcb-b6c3-85307c135344 req-26787509-1088-4bc2-9976-3435f2a52740 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-10099b3e-30dc-4fcb-b6c3-85307c135344 req-26787509-1088-4bc2-9976-3435f2a52740 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-10099b3e-30dc-4fcb-b6c3-85307c135344 req-26787509-1088-4bc2-9976-3435f2a52740 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:20 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-10099b3e-30dc-4fcb-b6c3-85307c135344 req-26787509-1088-4bc2-9976-3435f2a52740 service nova] Creating event network-vif-plugged:a88bc4ee-b024-4d26-9e56-e60daf6ef5fa for instance 1a83b839-7b5b-4004-94da-d196d18caf0f on user Apr 13 23:10:20 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-10099b3e-30dc-4fcb-b6c3-85307c135344 req-26787509-1088-4bc2-9976-3435f2a52740 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028899 Apr 13 23:10:20 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 268/804] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:10:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:10:20 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-c9f91f1d-3aaf-4456-b49b-58ce0d4b6f64 req-13834b6a-437d-459c-9c5e-7ad6b4bbecd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a83b839-7b5b-4004-94da-d196d18caf0f", "name": "network-vif-deleted", "tag": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:10:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c9f91f1d-3aaf-4456-b49b-58ce0d4b6f64 req-13834b6a-437d-459c-9c5e-7ad6b4bbecd3 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c9f91f1d-3aaf-4456-b49b-58ce0d4b6f64 req-13834b6a-437d-459c-9c5e-7ad6b4bbecd3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-c9f91f1d-3aaf-4456-b49b-58ce0d4b6f64 req-13834b6a-437d-459c-9c5e-7ad6b4bbecd3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:20 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-c9f91f1d-3aaf-4456-b49b-58ce0d4b6f64 req-13834b6a-437d-459c-9c5e-7ad6b4bbecd3 service nova] Creating event network-vif-deleted:a88bc4ee-b024-4d26-9e56-e60daf6ef5fa for instance 1a83b839-7b5b-4004-94da-d196d18caf0f on user Apr 13 23:10:20 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-c9f91f1d-3aaf-4456-b49b-58ce0d4b6f64 req-13834b6a-437d-459c-9c5e-7ad6b4bbecd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029983 Apr 13 23:10:20 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 271/805] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:10:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:10:43 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:10:43 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:10:43 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5a9586b2-b64d-4c32-9ceb-3988be86777f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:43 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-5a9586b2-b64d-4c32-9ceb-3988be86777f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:10:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5a9586b2-b64d-4c32-9ceb-3988be86777f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5a9586b2-b64d-4c32-9ceb-3988be86777f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5a9586b2-b64d-4c32-9ceb-3988be86777f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5a9586b2-b64d-4c32-9ceb-3988be86777f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5a9586b2-b64d-4c32-9ceb-3988be86777f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5a9586b2-b64d-4c32-9ceb-3988be86777f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:43 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-5a9586b2-b64d-4c32-9ceb-3988be86777f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] HTTP exception thrown: Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 could not be found. Apr 13 23:10:43 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5a9586b2-b64d-4c32-9ceb-3988be86777f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Request method failure captured: Apr 13 23:10:43 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555 HTTP/1.1 Apr 13 23:10:43 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:10:43 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:10:43 user devstack@n-api.service[61611]: Connection: close Apr 13 23:10:43 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:10:43 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:10:43 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:10:43 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:10:43 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:10:43 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIfHQxdyZtX-iu-ThNLEChPZxANikiWLMMCIRZ25gQuq3VxddslsqUB5ikMLZ2ePv4vTU-JsJ6azIW7Ww-AQ-OdqvQt7Sws4Wi7PO44E5yqLWKj1QiMLUT5MdNcavqRLksBSt368wMT-Wgo0vOgAq25fxnYJ3kH5oYJcbmhrlbtbUaQ Apr 13 23:10:43 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:10:43 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:10:43 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:10:43 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:10:43 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:10:43 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:10:43 user devstack@n-api.service[61611]: X-Project-Id: 5b6a1fccc07f4f5a8f8f8617ae03955d Apr 13 23:10:43 user devstack@n-api.service[61611]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-258614246 Apr 13 23:10:43 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:10:43 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:10:43 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5b6a1fccc07f4f5a8f8f8617ae03955d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b6a1fccc07f4f5a8f8f8617ae03955d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b6a1fccc07f4f5a8f8f8617ae03955d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:10:43 user devstack@n-api.service[61611]: X-Tenant: tempest-ServerRescueNegativeTestJSON-258614246 Apr 13 23:10:43 user devstack@n-api.service[61611]: X-Tenant-Id: 5b6a1fccc07f4f5a8f8f8617ae03955d Apr 13 23:10:43 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-258614246 Apr 13 23:10:43 user devstack@n-api.service[61611]: X-User: tempest-ServerRescueNegativeTestJSON-258614246-project-member Apr 13 23:10:43 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:10:43 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:10:43 user devstack@n-api.service[61611]: X-User-Id: 28cb6d8d6e3d4ef7aa53bb17faf495c4 Apr 13 23:10:43 user devstack@n-api.service[61611]: X-User-Name: tempest-ServerRescueNegativeTestJSON-258614246-project-member Apr 13 23:10:43 user devstack@n-api.service[61611]: method: > Apr 13 23:10:43 user devstack@n-api.service[61611]: exception: Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 could not be found. Apr 13 23:10:43 user devstack@n-api.service[61611]: action_args: {'id': 'df12dd8d-ea02-4c59-804d-52ae1bd4a555'} Apr 13 23:10:43 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 could not be found. Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 could not be found. Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 could not be found. Apr 13 23:10:43 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:10:43 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5a9586b2-b64d-4c32-9ceb-3988be86777f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Returning 404 to user: Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:10:43 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-5a9586b2-b64d-4c32-9ceb-3988be86777f tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555" status: 404 len: 111 microversion: 2.1 time: 0.037332 Apr 13 23:10:43 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 267/806] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:10:43 2023] GET /compute/v2.1/servers/df12dd8d-ea02-4c59-804d-52ae1bd4a555 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:10:44 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-6654cada-ac5d-4846-a3a7-36174b3961a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:44 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-6654cada-ac5d-4846-a3a7-36174b3961a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:10:44 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:10:44 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:10:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6654cada-ac5d-4846-a3a7-36174b3961a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6654cada-ac5d-4846-a3a7-36174b3961a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6654cada-ac5d-4846-a3a7-36174b3961a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6654cada-ac5d-4846-a3a7-36174b3961a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6654cada-ac5d-4846-a3a7-36174b3961a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6654cada-ac5d-4846-a3a7-36174b3961a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:44 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-6654cada-ac5d-4846-a3a7-36174b3961a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:10:44 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-6654cada-ac5d-4846-a3a7-36174b3961a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:10:44 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-6654cada-ac5d-4846-a3a7-36174b3961a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:10:44 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-6654cada-ac5d-4846-a3a7-36174b3961a0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962" status: 200 len: 1754 microversion: 2.87 time: 0.267570 Apr 13 23:10:44 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 269/807] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:10:44 2023] GET /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962 => generated 1754 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:10:45 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:10:45 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:10:46 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-82e07b50-d821-4e8d-90dc-c5f1fa0d58bc tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Action: 'create', calling method: .version_select at 0x7f3d1e1b0430>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1668706765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbB6sa0qGoo1uWEnwUaJj9s1UuIKgrOwtILphdBtTQizKy9xpM5DtQrXIJG+9yp8i8o8V+z8fU91AFXEqYnHagF++bPRquFDt0mPaYitTF7YiPTAyUmr8TXVZldj1JB0Q=="}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:10:46 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-82e07b50-d821-4e8d-90dc-c5f1fa0d58bc tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Getting quotas for project 59f4ef55afe342ebb945ad336e01582a. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:10:46 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-82e07b50-d821-4e8d-90dc-c5f1fa0d58bc tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Getting quotas for user d2a6385ae82042ad9682f7728b8263da and project 59f4ef55afe342ebb945ad336e01582a. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:10:46 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-82e07b50-d821-4e8d-90dc-c5f1fa0d58bc tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.208117 Apr 13 23:10:46 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 272/808] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 23:10:45 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:10:47 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1645185487", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1668706765", "security_groups": [{"name": "tempest-secgroup-smoke-281338410"}], "networks": [{"uuid": "58238917-04e7-4754-b79c-63038e274ac3"}]}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:10:47 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] validate_networks() for [('58238917-04e7-4754-b79c-63038e274ac3', None, None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:10:48 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:10:48 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:10:48 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:10:48 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:10:48 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:10:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:48 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Getting quotas for project 59f4ef55afe342ebb945ad336e01582a. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:10:48 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Getting quotas for user d2a6385ae82042ad9682f7728b8263da and project 59f4ef55afe342ebb945ad336e01582a. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:10:48 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:10:48 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:10:48 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.554942 Apr 13 23:10:48 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 268/809] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:10:47 2023] POST /compute/v2.1/servers => generated 403 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:10:48 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-6461ede4-2dc5-4edd-85dd-b0e95b0c074a tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:48 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-6461ede4-2dc5-4edd-85dd-b0e95b0c074a tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:10:48 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-6461ede4-2dc5-4edd-85dd-b0e95b0c074a tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6385ae82042ad9682f7728b8263da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f4ef55afe342ebb945ad336e01582a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:10:48 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-6461ede4-2dc5-4edd-85dd-b0e95b0c074a tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7" status: 200 len: 1257 microversion: 2.1 time: 0.072658 Apr 13 23:10:48 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 273/810] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:10:48 2023] GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7 => generated 1257 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:10:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-245979fa-0dea-41e2-bcc5-0d83fbd68dea tempest-VolumesGetTestJSON-1903678153 tempest-VolumesGetTestJSON-1903678153-project-member] Action: 'create', calling method: .version_select at 0x7f3d1de97760>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1229425292", "metadata": {"Type": "work"}}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:10:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-245979fa-0dea-41e2-bcc5-0d83fbd68dea tempest-VolumesGetTestJSON-1903678153 tempest-VolumesGetTestJSON-1903678153-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.455576 Apr 13 23:10:48 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 270/811] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 23:10:48 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 457 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 13 23:10:48 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-bcbc1e0c-0e55-491c-8fe1-ed65e8d61e2b tempest-VolumesGetTestJSON-1903678153 tempest-VolumesGetTestJSON-1903678153-project-member] Calling method '.version_select at 0x7f3d1c463d90>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:48 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-bcbc1e0c-0e55-491c-8fe1-ed65e8d61e2b tempest-VolumesGetTestJSON-1903678153 tempest-VolumesGetTestJSON-1903678153-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/abb843cd-72ff-4a60-aa93-94501512c126" status: 200 len: 353 microversion: 2.1 time: 0.054924 Apr 13 23:10:48 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 269/812] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 23:10:48 2023] GET /compute/v2.1/os-volumes/abb843cd-72ff-4a60-aa93-94501512c126 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:10:49 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-48ef0f98-90a7-4954-8a5c-d221cd023b39 tempest-VolumesGetTestJSON-1903678153 tempest-VolumesGetTestJSON-1903678153-project-member] Calling method '.version_select at 0x7f3d1e1b1900>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:49 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-48ef0f98-90a7-4954-8a5c-d221cd023b39 tempest-VolumesGetTestJSON-1903678153 tempest-VolumesGetTestJSON-1903678153-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/abb843cd-72ff-4a60-aa93-94501512c126" status: 200 len: 354 microversion: 2.1 time: 0.049898 Apr 13 23:10:49 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 274/813] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 23:10:49 2023] GET /compute/v2.1/os-volumes/abb843cd-72ff-4a60-aa93-94501512c126 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:10:49 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-f22811da-8359-4cfd-a59f-40c0ce2fc7b1 tempest-VolumesGetTestJSON-1903678153 tempest-VolumesGetTestJSON-1903678153-project-member] Calling method '.version_select at 0x7f3d1db06830>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:49 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-f22811da-8359-4cfd-a59f-40c0ce2fc7b1 tempest-VolumesGetTestJSON-1903678153 tempest-VolumesGetTestJSON-1903678153-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/abb843cd-72ff-4a60-aa93-94501512c126" status: 200 len: 354 microversion: 2.1 time: 0.054709 Apr 13 23:10:49 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 271/814] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 23:10:49 2023] GET /compute/v2.1/os-volumes/abb843cd-72ff-4a60-aa93-94501512c126 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:10:49 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f2549144-802c-403e-9f61-e2b5c541739a tempest-VolumesGetTestJSON-1903678153 tempest-VolumesGetTestJSON-1903678153-project-member] Calling method '.version_select at 0x7f3d1c3553f0>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:49 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f2549144-802c-403e-9f61-e2b5c541739a tempest-VolumesGetTestJSON-1903678153 tempest-VolumesGetTestJSON-1903678153-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/abb843cd-72ff-4a60-aa93-94501512c126" status: 202 len: 0 microversion: 2.1 time: 0.063737 Apr 13 23:10:49 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 270/815] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 23:10:49 2023] DELETE /compute/v2.1/os-volumes/abb843cd-72ff-4a60-aa93-94501512c126 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:10:49 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-bfb3537d-9681-4ab7-aff4-1796d59c253d tempest-VolumesGetTestJSON-1903678153 tempest-VolumesGetTestJSON-1903678153-project-member] Calling method '.version_select at 0x7f3d1df0fa30>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:50 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-bfb3537d-9681-4ab7-aff4-1796d59c253d tempest-VolumesGetTestJSON-1903678153 tempest-VolumesGetTestJSON-1903678153-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/abb843cd-72ff-4a60-aa93-94501512c126" status: 200 len: 353 microversion: 2.1 time: 0.060757 Apr 13 23:10:50 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 275/816] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 23:10:49 2023] GET /compute/v2.1/os-volumes/abb843cd-72ff-4a60-aa93-94501512c126 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:10:51 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-605a1ca2-b0bd-4c17-9335-0593ca0c618e tempest-VolumesGetTestJSON-1903678153 tempest-VolumesGetTestJSON-1903678153-project-member] Calling method '.version_select at 0x7f3d1de95510>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:51 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-605a1ca2-b0bd-4c17-9335-0593ca0c618e tempest-VolumesGetTestJSON-1903678153 tempest-VolumesGetTestJSON-1903678153-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/abb843cd-72ff-4a60-aa93-94501512c126" status: 200 len: 353 microversion: 2.1 time: 0.053193 Apr 13 23:10:51 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 272/817] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 23:10:51 2023] GET /compute/v2.1/os-volumes/abb843cd-72ff-4a60-aa93-94501512c126 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:10:51 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-af98b6ac-6542-4091-9d3f-9c98abcf689b req-58b042cc-8cd2-428e-bac5-da36673dd35b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9de39303-da44-47ae-adef-ff80f0b792a7", "tag": "16379ba5-9e41-4846-9ac8-8b5e86b776c0"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:10:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-af98b6ac-6542-4091-9d3f-9c98abcf689b req-58b042cc-8cd2-428e-bac5-da36673dd35b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-af98b6ac-6542-4091-9d3f-9c98abcf689b req-58b042cc-8cd2-428e-bac5-da36673dd35b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-af98b6ac-6542-4091-9d3f-9c98abcf689b req-58b042cc-8cd2-428e-bac5-da36673dd35b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:51 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-af98b6ac-6542-4091-9d3f-9c98abcf689b req-58b042cc-8cd2-428e-bac5-da36673dd35b service nova] Creating event network-changed:16379ba5-9e41-4846-9ac8-8b5e86b776c0 for instance 9de39303-da44-47ae-adef-ff80f0b792a7 on user Apr 13 23:10:51 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-af98b6ac-6542-4091-9d3f-9c98abcf689b req-58b042cc-8cd2-428e-bac5-da36673dd35b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030905 Apr 13 23:10:51 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 271/818] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:10:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 23:10:52 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-bdda46c9-50c5-428c-8607-0c6782ecab09 tempest-VolumesGetTestJSON-1903678153 tempest-VolumesGetTestJSON-1903678153-project-member] Calling method '.version_select at 0x7f3d1de76d40>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:52 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-bdda46c9-50c5-428c-8607-0c6782ecab09 tempest-VolumesGetTestJSON-1903678153 tempest-VolumesGetTestJSON-1903678153-project-member] HTTP exception thrown: Volume abb843cd-72ff-4a60-aa93-94501512c126 could not be found. Apr 13 23:10:52 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-bdda46c9-50c5-428c-8607-0c6782ecab09 tempest-VolumesGetTestJSON-1903678153 tempest-VolumesGetTestJSON-1903678153-project-member] Request method failure captured: Apr 13 23:10:52 user devstack@n-api.service[61613]: request: GET /compute/v2.1/os-volumes/abb843cd-72ff-4a60-aa93-94501512c126 HTTP/1.1 Apr 13 23:10:52 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:10:52 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:10:52 user devstack@n-api.service[61613]: Connection: close Apr 13 23:10:52 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:10:52 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:10:52 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:10:52 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:10:52 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:10:52 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIv4Vf-uFSXlll-F0XugojBZTcHZnYjeRVkdaDGAUkIEM5sXSgkQHjqjYozdTDgeh6keKcnfKuOEGq9z7eO209WMOTFcQTACBjcM6asFKzTlYWr4ZPfjwn3gi3lYD5HPt30gS7gH2e8ntWKPdZp_mX58AEkJjtEYvaUbPl-5zH74fjI Apr 13 23:10:52 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:10:52 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:10:52 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:10:52 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:10:52 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:10:52 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:10:52 user devstack@n-api.service[61613]: X-Project-Id: 4552c91718284703b83c00e0d6ac4019 Apr 13 23:10:52 user devstack@n-api.service[61613]: X-Project-Name: tempest-VolumesGetTestJSON-1903678153 Apr 13 23:10:52 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:10:52 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:10:52 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4552c91718284703b83c00e0d6ac4019"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4552c91718284703b83c00e0d6ac4019"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4552c91718284703b83c00e0d6ac4019"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:10:52 user devstack@n-api.service[61613]: X-Tenant: tempest-VolumesGetTestJSON-1903678153 Apr 13 23:10:52 user devstack@n-api.service[61613]: X-Tenant-Id: 4552c91718284703b83c00e0d6ac4019 Apr 13 23:10:52 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-VolumesGetTestJSON-1903678153 Apr 13 23:10:52 user devstack@n-api.service[61613]: X-User: tempest-VolumesGetTestJSON-1903678153-project-member Apr 13 23:10:52 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:10:52 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:10:52 user devstack@n-api.service[61613]: X-User-Id: 86b6bf209d214f3cb6259d48fbf1cac8 Apr 13 23:10:52 user devstack@n-api.service[61613]: X-User-Name: tempest-VolumesGetTestJSON-1903678153-project-member Apr 13 23:10:52 user devstack@n-api.service[61613]: method: Apr 13 23:10:52 user devstack@n-api.service[61613]: exception: Volume abb843cd-72ff-4a60-aa93-94501512c126 could not be found. Apr 13 23:10:52 user devstack@n-api.service[61613]: action_args: {'id': 'abb843cd-72ff-4a60-aa93-94501512c126'} Apr 13 23:10:52 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume abb843cd-72ff-4a60-aa93-94501512c126 could not be found. (HTTP 404) (Request-ID: req-82a07b0c-9610-4f04-9c87-560659428a13) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume abb843cd-72ff-4a60-aa93-94501512c126 could not be found. Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume abb843cd-72ff-4a60-aa93-94501512c126 could not be found. Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume abb843cd-72ff-4a60-aa93-94501512c126 could not be found. Apr 13 23:10:52 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:10:52 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-bdda46c9-50c5-428c-8607-0c6782ecab09 tempest-VolumesGetTestJSON-1903678153 tempest-VolumesGetTestJSON-1903678153-project-member] Returning 404 to user: Volume abb843cd-72ff-4a60-aa93-94501512c126 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:10:52 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-bdda46c9-50c5-428c-8607-0c6782ecab09 tempest-VolumesGetTestJSON-1903678153 tempest-VolumesGetTestJSON-1903678153-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/abb843cd-72ff-4a60-aa93-94501512c126" status: 404 len: 109 microversion: 2.1 time: 0.047073 Apr 13 23:10:52 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 276/819] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 23:10:52 2023] GET /compute/v2.1/os-volumes/abb843cd-72ff-4a60-aa93-94501512c126 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:10:53 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-5341d9ff-03e0-48d1-aef3-97fa0d3855e4 req-6da2dd06-4e54-40d8-8c22-58eef0704bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9de39303-da44-47ae-adef-ff80f0b792a7", "name": "network-vif-plugged", "status": "completed", "tag": "16379ba5-9e41-4846-9ac8-8b5e86b776c0"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:10:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-5341d9ff-03e0-48d1-aef3-97fa0d3855e4 req-6da2dd06-4e54-40d8-8c22-58eef0704bcb service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-5341d9ff-03e0-48d1-aef3-97fa0d3855e4 req-6da2dd06-4e54-40d8-8c22-58eef0704bcb service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-5341d9ff-03e0-48d1-aef3-97fa0d3855e4 req-6da2dd06-4e54-40d8-8c22-58eef0704bcb service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:53 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-5341d9ff-03e0-48d1-aef3-97fa0d3855e4 req-6da2dd06-4e54-40d8-8c22-58eef0704bcb service nova] Creating event network-vif-plugged:16379ba5-9e41-4846-9ac8-8b5e86b776c0 for instance 9de39303-da44-47ae-adef-ff80f0b792a7 on user Apr 13 23:10:53 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-5341d9ff-03e0-48d1-aef3-97fa0d3855e4 req-6da2dd06-4e54-40d8-8c22-58eef0704bcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044170 Apr 13 23:10:53 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 273/820] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:10:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:10:55 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-b0b5b5e9-6007-4105-8b7f-616d55b53cf2 req-9f90c746-1181-4367-8c9c-191d52cf819e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9de39303-da44-47ae-adef-ff80f0b792a7", "name": "network-vif-plugged", "status": "completed", "tag": "16379ba5-9e41-4846-9ac8-8b5e86b776c0"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:10:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-b0b5b5e9-6007-4105-8b7f-616d55b53cf2 req-9f90c746-1181-4367-8c9c-191d52cf819e service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-b0b5b5e9-6007-4105-8b7f-616d55b53cf2 req-9f90c746-1181-4367-8c9c-191d52cf819e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-b0b5b5e9-6007-4105-8b7f-616d55b53cf2 req-9f90c746-1181-4367-8c9c-191d52cf819e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:55 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-b0b5b5e9-6007-4105-8b7f-616d55b53cf2 req-9f90c746-1181-4367-8c9c-191d52cf819e service nova] Creating event network-vif-plugged:16379ba5-9e41-4846-9ac8-8b5e86b776c0 for instance 9de39303-da44-47ae-adef-ff80f0b792a7 on user Apr 13 23:10:55 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-b0b5b5e9-6007-4105-8b7f-616d55b53cf2 req-9f90c746-1181-4367-8c9c-191d52cf819e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053830 Apr 13 23:10:55 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 272/821] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:10:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5d6063bd-6d2b-45da-a0aa-cda52924ff6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-5d6063bd-6d2b-45da-a0aa-cda52924ff6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5d6063bd-6d2b-45da-a0aa-cda52924ff6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5d6063bd-6d2b-45da-a0aa-cda52924ff6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5d6063bd-6d2b-45da-a0aa-cda52924ff6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5d6063bd-6d2b-45da-a0aa-cda52924ff6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5d6063bd-6d2b-45da-a0aa-cda52924ff6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5d6063bd-6d2b-45da-a0aa-cda52924ff6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:59 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-5d6063bd-6d2b-45da-a0aa-cda52924ff6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] HTTP exception thrown: Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 could not be found. Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5d6063bd-6d2b-45da-a0aa-cda52924ff6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Request method failure captured: Apr 13 23:10:59 user devstack@n-api.service[61613]: request: DELETE /compute/v2.1/servers/47dce1cc-c872-41f3-81af-acfc6ccabe18 HTTP/1.1 Apr 13 23:10:59 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:10:59 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:10:59 user devstack@n-api.service[61613]: Connection: close Apr 13 23:10:59 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:10:59 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:10:59 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:10:59 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:10:59 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:10:59 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIn1WpkCHTcQ3vsm6vuXvLMwBukWR3T78fUteB1g1zobAkavXEwqiMsjm9a7O1wQSAPbhSneJ4g36HRneth-jvcWNhT4bg4W3DOs07jcjQHnm6EdcnPlV6wX56fpXkxsD2Vss9a8TpT8oI4bKWdzWDXg8gRXoxb6iO_eerJkHkQeHrY Apr 13 23:10:59 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:10:59 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:10:59 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:10:59 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:10:59 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:10:59 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:10:59 user devstack@n-api.service[61613]: X-Project-Id: d8a3c684b0414336b2ca770eb1f3ab17 Apr 13 23:10:59 user devstack@n-api.service[61613]: X-Project-Name: tempest-ServersNegativeTestJSON-1433854176 Apr 13 23:10:59 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:10:59 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:10:59 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d8a3c684b0414336b2ca770eb1f3ab17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8a3c684b0414336b2ca770eb1f3ab17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8a3c684b0414336b2ca770eb1f3ab17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:10:59 user devstack@n-api.service[61613]: X-Tenant: tempest-ServersNegativeTestJSON-1433854176 Apr 13 23:10:59 user devstack@n-api.service[61613]: X-Tenant-Id: d8a3c684b0414336b2ca770eb1f3ab17 Apr 13 23:10:59 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1433854176 Apr 13 23:10:59 user devstack@n-api.service[61613]: X-User: tempest-ServersNegativeTestJSON-1433854176-project-member Apr 13 23:10:59 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:10:59 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:10:59 user devstack@n-api.service[61613]: X-User-Id: 71593deacbd74fea9fc2faf5a9b08877 Apr 13 23:10:59 user devstack@n-api.service[61613]: X-User-Name: tempest-ServersNegativeTestJSON-1433854176-project-member Apr 13 23:10:59 user devstack@n-api.service[61613]: method: > Apr 13 23:10:59 user devstack@n-api.service[61613]: exception: Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 could not be found. Apr 13 23:10:59 user devstack@n-api.service[61613]: action_args: {'id': '47dce1cc-c872-41f3-81af-acfc6ccabe18'} Apr 13 23:10:59 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 could not be found. Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 could not be found. Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 could not be found. Apr 13 23:10:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5d6063bd-6d2b-45da-a0aa-cda52924ff6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Returning 404 to user: Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:10:59 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-5d6063bd-6d2b-45da-a0aa-cda52924ff6d tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/47dce1cc-c872-41f3-81af-acfc6ccabe18" status: 404 len: 111 microversion: 2.1 time: 0.076687 Apr 13 23:10:59 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 277/822] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:10:59 2023] DELETE /compute/v2.1/servers/47dce1cc-c872-41f3-81af-acfc6ccabe18 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 13 23:10:59 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-270a8055-afa1-48c5-bcce-9bac0c9bd647 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:59 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-270a8055-afa1-48c5-bcce-9bac0c9bd647 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:10:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-270a8055-afa1-48c5-bcce-9bac0c9bd647 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-270a8055-afa1-48c5-bcce-9bac0c9bd647 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-270a8055-afa1-48c5-bcce-9bac0c9bd647 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-270a8055-afa1-48c5-bcce-9bac0c9bd647 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-270a8055-afa1-48c5-bcce-9bac0c9bd647 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-270a8055-afa1-48c5-bcce-9bac0c9bd647 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:59 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-270a8055-afa1-48c5-bcce-9bac0c9bd647 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] HTTP exception thrown: Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 could not be found. Apr 13 23:10:59 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-270a8055-afa1-48c5-bcce-9bac0c9bd647 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Request method failure captured: Apr 13 23:10:59 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/47dce1cc-c872-41f3-81af-acfc6ccabe18 HTTP/1.1 Apr 13 23:10:59 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:10:59 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:10:59 user devstack@n-api.service[61612]: Connection: close Apr 13 23:10:59 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:10:59 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:10:59 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:10:59 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:10:59 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:10:59 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIn1WpkCHTcQ3vsm6vuXvLMwBukWR3T78fUteB1g1zobAkavXEwqiMsjm9a7O1wQSAPbhSneJ4g36HRneth-jvcWNhT4bg4W3DOs07jcjQHnm6EdcnPlV6wX56fpXkxsD2Vss9a8TpT8oI4bKWdzWDXg8gRXoxb6iO_eerJkHkQeHrY Apr 13 23:10:59 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:10:59 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:10:59 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:10:59 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:10:59 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:10:59 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:10:59 user devstack@n-api.service[61612]: X-Project-Id: d8a3c684b0414336b2ca770eb1f3ab17 Apr 13 23:10:59 user devstack@n-api.service[61612]: X-Project-Name: tempest-ServersNegativeTestJSON-1433854176 Apr 13 23:10:59 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:10:59 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:10:59 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d8a3c684b0414336b2ca770eb1f3ab17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8a3c684b0414336b2ca770eb1f3ab17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8a3c684b0414336b2ca770eb1f3ab17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:10:59 user devstack@n-api.service[61612]: X-Tenant: tempest-ServersNegativeTestJSON-1433854176 Apr 13 23:10:59 user devstack@n-api.service[61612]: X-Tenant-Id: d8a3c684b0414336b2ca770eb1f3ab17 Apr 13 23:10:59 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1433854176 Apr 13 23:10:59 user devstack@n-api.service[61612]: X-User: tempest-ServersNegativeTestJSON-1433854176-project-member Apr 13 23:10:59 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:10:59 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:10:59 user devstack@n-api.service[61612]: X-User-Id: 71593deacbd74fea9fc2faf5a9b08877 Apr 13 23:10:59 user devstack@n-api.service[61612]: X-User-Name: tempest-ServersNegativeTestJSON-1433854176-project-member Apr 13 23:10:59 user devstack@n-api.service[61612]: method: > Apr 13 23:10:59 user devstack@n-api.service[61612]: exception: Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 could not be found. Apr 13 23:10:59 user devstack@n-api.service[61612]: action_args: {'id': '47dce1cc-c872-41f3-81af-acfc6ccabe18'} Apr 13 23:10:59 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 could not be found. Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 could not be found. Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 could not be found. Apr 13 23:10:59 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:10:59 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-270a8055-afa1-48c5-bcce-9bac0c9bd647 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Returning 404 to user: Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:10:59 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-270a8055-afa1-48c5-bcce-9bac0c9bd647 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47dce1cc-c872-41f3-81af-acfc6ccabe18" status: 404 len: 111 microversion: 2.1 time: 0.031565 Apr 13 23:10:59 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 274/823] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:10:59 2023] GET /compute/v2.1/servers/47dce1cc-c872-41f3-81af-acfc6ccabe18 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:10:59 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:10:59 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:10:59 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:59 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:10:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:59 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:10:59 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dc473fb8-e574-4e49-b860-3ae0066cc9b8" status: 204 len: 0 microversion: 2.1 time: 0.141566 Apr 13 23:10:59 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 273/824] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:10:59 2023] DELETE /compute/v2.1/servers/dc473fb8-e574-4e49-b860-3ae0066cc9b8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-cf3cd610-a501-4774-b7e9-cac4461e5642 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-cf3cd610-a501-4774-b7e9-cac4461e5642 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-cf3cd610-a501-4774-b7e9-cac4461e5642 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-cf3cd610-a501-4774-b7e9-cac4461e5642 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-cf3cd610-a501-4774-b7e9-cac4461e5642 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-cf3cd610-a501-4774-b7e9-cac4461e5642 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-cf3cd610-a501-4774-b7e9-cac4461e5642 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-cf3cd610-a501-4774-b7e9-cac4461e5642 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:10:59 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-cf3cd610-a501-4774-b7e9-cac4461e5642 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71593deacbd74fea9fc2faf5a9b08877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a3c684b0414336b2ca770eb1f3ab17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:10:59 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-cf3cd610-a501-4774-b7e9-cac4461e5642 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc473fb8-e574-4e49-b860-3ae0066cc9b8" status: 200 len: 1497 microversion: 2.1 time: 0.206867 Apr 13 23:10:59 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 278/825] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:10:59 2023] GET /compute/v2.1/servers/dc473fb8-e574-4e49-b860-3ae0066cc9b8 => generated 1497 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:11:00 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-80dbab4e-ca89-4081-b20e-5f0df981bdba req-0c592591-96cf-4662-b624-3b9ac0e265b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc473fb8-e574-4e49-b860-3ae0066cc9b8", "name": "network-vif-unplugged", "status": "completed", "tag": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-80dbab4e-ca89-4081-b20e-5f0df981bdba req-0c592591-96cf-4662-b624-3b9ac0e265b1 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-80dbab4e-ca89-4081-b20e-5f0df981bdba req-0c592591-96cf-4662-b624-3b9ac0e265b1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-80dbab4e-ca89-4081-b20e-5f0df981bdba req-0c592591-96cf-4662-b624-3b9ac0e265b1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:00 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-80dbab4e-ca89-4081-b20e-5f0df981bdba req-0c592591-96cf-4662-b624-3b9ac0e265b1 service nova] Creating event network-vif-unplugged:29e91af8-5b8e-4872-9ee0-9cc4b79fb647 for instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 on user Apr 13 23:11:00 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-80dbab4e-ca89-4081-b20e-5f0df981bdba req-0c592591-96cf-4662-b624-3b9ac0e265b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035665 Apr 13 23:11:00 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 275/826] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:11:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:11:01 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-dd59239c-b408-420a-91ba-b2eab49b42d7 req-ca5cccdd-9379-4ff1-b978-0b7f41eaeb63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc473fb8-e574-4e49-b860-3ae0066cc9b8", "name": "network-vif-deleted", "tag": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-dd59239c-b408-420a-91ba-b2eab49b42d7 req-ca5cccdd-9379-4ff1-b978-0b7f41eaeb63 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-dd59239c-b408-420a-91ba-b2eab49b42d7 req-ca5cccdd-9379-4ff1-b978-0b7f41eaeb63 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-dd59239c-b408-420a-91ba-b2eab49b42d7 req-ca5cccdd-9379-4ff1-b978-0b7f41eaeb63 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:01 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-dd59239c-b408-420a-91ba-b2eab49b42d7 req-ca5cccdd-9379-4ff1-b978-0b7f41eaeb63 service nova] Creating event network-vif-deleted:29e91af8-5b8e-4872-9ee0-9cc4b79fb647 for instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 on user Apr 13 23:11:01 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-dd59239c-b408-420a-91ba-b2eab49b42d7 req-ca5cccdd-9379-4ff1-b978-0b7f41eaeb63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035442 Apr 13 23:11:01 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 274/827] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:11:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:11:02 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc473fb8-e574-4e49-b860-3ae0066cc9b8", "name": "network-vif-plugged", "status": "completed", "tag": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647"}, {"server_uuid": "dc473fb8-e574-4e49-b860-3ae0066cc9b8", "name": "network-vif-plugged", "status": "completed", "tag": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647"}, {"server_uuid": "dc473fb8-e574-4e49-b860-3ae0066cc9b8", "name": "network-vif-plugged", "status": "completed", "tag": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647"}, {"server_uuid": "dc473fb8-e574-4e49-b860-3ae0066cc9b8", "name": "network-vif-unplugged", "status": "completed", "tag": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647"}, {"server_uuid": "dc473fb8-e574-4e49-b860-3ae0066cc9b8", "name": "network-vif-plugged", "status": "completed", "tag": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Creating event network-vif-plugged:29e91af8-5b8e-4872-9ee0-9cc4b79fb647 for instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 on user Apr 13 23:11:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Creating event network-vif-plugged:29e91af8-5b8e-4872-9ee0-9cc4b79fb647 for instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 on user Apr 13 23:11:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Creating event network-vif-plugged:29e91af8-5b8e-4872-9ee0-9cc4b79fb647 for instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 on user Apr 13 23:11:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Creating event network-vif-unplugged:29e91af8-5b8e-4872-9ee0-9cc4b79fb647 for instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 on user Apr 13 23:11:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Creating event network-vif-plugged:29e91af8-5b8e-4872-9ee0-9cc4b79fb647 for instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 on user Apr 13 23:11:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.036994 Apr 13 23:11:02 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 279/828] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:11:02 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:11:06 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-a7149f3e-de95-46a7-b6f0-7e32074fe14f tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:11:06 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-a7149f3e-de95-46a7-b6f0-7e32074fe14f tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:11:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a7149f3e-de95-46a7-b6f0-7e32074fe14f tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a7149f3e-de95-46a7-b6f0-7e32074fe14f tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a7149f3e-de95-46a7-b6f0-7e32074fe14f tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a7149f3e-de95-46a7-b6f0-7e32074fe14f tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a7149f3e-de95-46a7-b6f0-7e32074fe14f tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a7149f3e-de95-46a7-b6f0-7e32074fe14f tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:06 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-a7149f3e-de95-46a7-b6f0-7e32074fe14f tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] HTTP exception thrown: Instance d3dc82c4-502a-4ff9-a230-129269f5c0e6 could not be found. Apr 13 23:11:06 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-a7149f3e-de95-46a7-b6f0-7e32074fe14f tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Request method failure captured: Apr 13 23:11:06 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/d3dc82c4-502a-4ff9-a230-129269f5c0e6 HTTP/1.1 Apr 13 23:11:06 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:11:06 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:11:06 user devstack@n-api.service[61612]: Connection: close Apr 13 23:11:06 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:11:06 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:11:06 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:11:06 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:11:06 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:11:06 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOItlmM2WEyUn9lhtKjlxPi7Wqj5AxEXKiv4TeOeD7IeWKQbNz2gKoaX_XfEGNcSdyzWx21D8elVRAjhbWPZgXUjGS61Mzrez5Jy2NWKAFA7Bl9fO-maOGl0Fq9Atipe99en6g3b46BjKe3qKNUCpvCja9MC6xb3qQb5u5qw5b9YFQcw Apr 13 23:11:06 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:11:06 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:11:06 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:11:06 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:11:06 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:11:06 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:11:06 user devstack@n-api.service[61612]: X-Project-Id: c6455f36704e4b3088d8a9114b087fd3 Apr 13 23:11:06 user devstack@n-api.service[61612]: X-Project-Name: tempest-VolumesActionsTest-1756435814 Apr 13 23:11:06 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:11:06 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:11:06 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c6455f36704e4b3088d8a9114b087fd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c6455f36704e4b3088d8a9114b087fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c6455f36704e4b3088d8a9114b087fd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:11:06 user devstack@n-api.service[61612]: X-Tenant: tempest-VolumesActionsTest-1756435814 Apr 13 23:11:06 user devstack@n-api.service[61612]: X-Tenant-Id: c6455f36704e4b3088d8a9114b087fd3 Apr 13 23:11:06 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-VolumesActionsTest-1756435814 Apr 13 23:11:06 user devstack@n-api.service[61612]: X-User: tempest-VolumesActionsTest-1756435814-project-member Apr 13 23:11:06 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:11:06 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:11:06 user devstack@n-api.service[61612]: X-User-Id: 8c235879bc444a819061c4bb4bf3441b Apr 13 23:11:06 user devstack@n-api.service[61612]: X-User-Name: tempest-VolumesActionsTest-1756435814-project-member Apr 13 23:11:06 user devstack@n-api.service[61612]: method: > Apr 13 23:11:06 user devstack@n-api.service[61612]: exception: Instance d3dc82c4-502a-4ff9-a230-129269f5c0e6 could not be found. Apr 13 23:11:06 user devstack@n-api.service[61612]: action_args: {'id': 'd3dc82c4-502a-4ff9-a230-129269f5c0e6'} Apr 13 23:11:06 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3dc82c4-502a-4ff9-a230-129269f5c0e6 could not be found. Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3dc82c4-502a-4ff9-a230-129269f5c0e6 could not be found. Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3dc82c4-502a-4ff9-a230-129269f5c0e6 could not be found. Apr 13 23:11:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:11:06 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-a7149f3e-de95-46a7-b6f0-7e32074fe14f tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Returning 404 to user: Instance d3dc82c4-502a-4ff9-a230-129269f5c0e6 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:11:06 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-a7149f3e-de95-46a7-b6f0-7e32074fe14f tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3dc82c4-502a-4ff9-a230-129269f5c0e6" status: 404 len: 111 microversion: 2.1 time: 0.030060 Apr 13 23:11:06 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 276/829] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:11:06 2023] GET /compute/v2.1/servers/d3dc82c4-502a-4ff9-a230-129269f5c0e6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:11:06 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1650373439", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "networks": [{"uuid": "6d2922dc-e5ab-475a-9b4e-453595ade8a1"}]}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:06 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-404c6241-c94f-4c4c-9e78-9def15f9493b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:11:06 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-404c6241-c94f-4c4c-9e78-9def15f9493b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:11:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-404c6241-c94f-4c4c-9e78-9def15f9493b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-404c6241-c94f-4c4c-9e78-9def15f9493b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-404c6241-c94f-4c4c-9e78-9def15f9493b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-404c6241-c94f-4c4c-9e78-9def15f9493b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-404c6241-c94f-4c4c-9e78-9def15f9493b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-404c6241-c94f-4c4c-9e78-9def15f9493b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-404c6241-c94f-4c4c-9e78-9def15f9493b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] HTTP exception thrown: Instance 1a83b839-7b5b-4004-94da-d196d18caf0f could not be found. Apr 13 23:11:06 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-404c6241-c94f-4c4c-9e78-9def15f9493b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Request method failure captured: Apr 13 23:11:06 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/1a83b839-7b5b-4004-94da-d196d18caf0f HTTP/1.1 Apr 13 23:11:06 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:11:06 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:11:06 user devstack@n-api.service[61613]: Connection: close Apr 13 23:11:06 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:11:06 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:11:06 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:11:06 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:11:06 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:11:06 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIgE6Gl7ZSFkA-_Uvg9_1wPLldz_ScwHJLtH7XfCRP3AC2MJmMpZ7l9bcSBPK09rKumFcFKFuRTWt2Sf1d4N5k3NQaJGxn8JzsH44PLD5fzCs7WE6phnuUwwFlbCj4pm_qJgudGzAbO1tRiQjdcyEvfY3Ke0cXzXFHfEZxyouzAaMTk Apr 13 23:11:06 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:11:06 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:11:06 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:11:06 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:11:06 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:11:06 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:11:06 user devstack@n-api.service[61613]: X-Project-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:11:06 user devstack@n-api.service[61613]: X-Project-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:11:06 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:11:06 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:11:06 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:11:06 user devstack@n-api.service[61613]: X-Tenant: tempest-TestVolumeBootPattern-751187467 Apr 13 23:11:06 user devstack@n-api.service[61613]: X-Tenant-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:11:06 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:11:06 user devstack@n-api.service[61613]: X-User: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:11:06 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:11:06 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:11:06 user devstack@n-api.service[61613]: X-User-Id: b289294050af4c41aeef8401832487a1 Apr 13 23:11:06 user devstack@n-api.service[61613]: X-User-Name: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:11:06 user devstack@n-api.service[61613]: method: > Apr 13 23:11:06 user devstack@n-api.service[61613]: exception: Instance 1a83b839-7b5b-4004-94da-d196d18caf0f could not be found. Apr 13 23:11:06 user devstack@n-api.service[61613]: action_args: {'id': '1a83b839-7b5b-4004-94da-d196d18caf0f'} Apr 13 23:11:06 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a83b839-7b5b-4004-94da-d196d18caf0f could not be found. Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a83b839-7b5b-4004-94da-d196d18caf0f could not be found. Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a83b839-7b5b-4004-94da-d196d18caf0f could not be found. Apr 13 23:11:06 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:11:06 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-404c6241-c94f-4c4c-9e78-9def15f9493b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Returning 404 to user: Instance 1a83b839-7b5b-4004-94da-d196d18caf0f could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:11:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-404c6241-c94f-4c4c-9e78-9def15f9493b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a83b839-7b5b-4004-94da-d196d18caf0f" status: 404 len: 111 microversion: 2.1 time: 0.042730 Apr 13 23:11:06 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 280/830] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:11:06 2023] GET /compute/v2.1/servers/1a83b839-7b5b-4004-94da-d196d18caf0f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:11:06 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] validate_networks() for [('6d2922dc-e5ab-475a-9b4e-453595ade8a1', None, None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Getting quotas for project c6455f36704e4b3088d8a9114b087fd3. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Getting quotas for user 8c235879bc444a819061c4bb4bf3441b and project c6455f36704e4b3088d8a9114b087fd3. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:11:07 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.727964 Apr 13 23:11:07 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 275/831] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:11:06 2023] POST /compute/v2.1/servers => generated 378 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:11:07 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-c90d8edb-118c-4d2b-9d88-534728f71cd3 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:11:07 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-c90d8edb-118c-4d2b-9d88-534728f71cd3 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:11:07 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e415cf54-d8fc-4c6f-bbee-93ebb0f5d79c tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:11:07 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-e415cf54-d8fc-4c6f-bbee-93ebb0f5d79c tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:11:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e415cf54-d8fc-4c6f-bbee-93ebb0f5d79c tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e415cf54-d8fc-4c6f-bbee-93ebb0f5d79c tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e415cf54-d8fc-4c6f-bbee-93ebb0f5d79c tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e415cf54-d8fc-4c6f-bbee-93ebb0f5d79c tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e415cf54-d8fc-4c6f-bbee-93ebb0f5d79c tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e415cf54-d8fc-4c6f-bbee-93ebb0f5d79c tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:07 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-e415cf54-d8fc-4c6f-bbee-93ebb0f5d79c tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] HTTP exception thrown: Instance 06ecf305-65ca-4752-984c-cb7094593493 could not be found. Apr 13 23:11:07 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e415cf54-d8fc-4c6f-bbee-93ebb0f5d79c tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Request method failure captured: Apr 13 23:11:07 user devstack@n-api.service[61613]: request: DELETE /compute/v2.1/servers/06ecf305-65ca-4752-984c-cb7094593493 HTTP/1.1 Apr 13 23:11:07 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:11:07 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:11:07 user devstack@n-api.service[61613]: Connection: close Apr 13 23:11:07 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:11:07 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:11:07 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:11:07 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:11:07 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:11:07 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIgE6Gl7ZSFkA-_Uvg9_1wPLldz_ScwHJLtH7XfCRP3AC2MJmMpZ7l9bcSBPK09rKumFcFKFuRTWt2Sf1d4N5k3NQaJGxn8JzsH44PLD5fzCs7WE6phnuUwwFlbCj4pm_qJgudGzAbO1tRiQjdcyEvfY3Ke0cXzXFHfEZxyouzAaMTk Apr 13 23:11:07 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:11:07 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:11:07 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:11:07 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:11:07 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:11:07 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:11:07 user devstack@n-api.service[61613]: X-Project-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:11:07 user devstack@n-api.service[61613]: X-Project-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:11:07 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:11:07 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:11:07 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:11:07 user devstack@n-api.service[61613]: X-Tenant: tempest-TestVolumeBootPattern-751187467 Apr 13 23:11:07 user devstack@n-api.service[61613]: X-Tenant-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:11:07 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:11:07 user devstack@n-api.service[61613]: X-User: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:11:07 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:11:07 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:11:07 user devstack@n-api.service[61613]: X-User-Id: b289294050af4c41aeef8401832487a1 Apr 13 23:11:07 user devstack@n-api.service[61613]: X-User-Name: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:11:07 user devstack@n-api.service[61613]: method: > Apr 13 23:11:07 user devstack@n-api.service[61613]: exception: Instance 06ecf305-65ca-4752-984c-cb7094593493 could not be found. Apr 13 23:11:07 user devstack@n-api.service[61613]: action_args: {'id': '06ecf305-65ca-4752-984c-cb7094593493'} Apr 13 23:11:07 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06ecf305-65ca-4752-984c-cb7094593493 could not be found. Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06ecf305-65ca-4752-984c-cb7094593493 could not be found. Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06ecf305-65ca-4752-984c-cb7094593493 could not be found. Apr 13 23:11:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:11:07 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e415cf54-d8fc-4c6f-bbee-93ebb0f5d79c tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Returning 404 to user: Instance 06ecf305-65ca-4752-984c-cb7094593493 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:11:07 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-e415cf54-d8fc-4c6f-bbee-93ebb0f5d79c tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/06ecf305-65ca-4752-984c-cb7094593493" status: 404 len: 111 microversion: 2.1 time: 0.031988 Apr 13 23:11:07 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 281/832] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:11:07 2023] DELETE /compute/v2.1/servers/06ecf305-65ca-4752-984c-cb7094593493 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f2289729-dc0b-4d80-90a1-940dae9a2a88 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f2289729-dc0b-4d80-90a1-940dae9a2a88 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:11:07 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-c90d8edb-118c-4d2b-9d88-534728f71cd3 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c235879bc444a819061c4bb4bf3441b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6455f36704e4b3088d8a9114b087fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:11:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-c90d8edb-118c-4d2b-9d88-534728f71cd3 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6969342-d92d-4841-99a5-466d2eff89c2" status: 200 len: 1208 microversion: 2.1 time: 0.067903 Apr 13 23:11:07 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 277/833] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:11:07 2023] GET /compute/v2.1/servers/d6969342-d92d-4841-99a5-466d2eff89c2 => generated 1208 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f2289729-dc0b-4d80-90a1-940dae9a2a88 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f2289729-dc0b-4d80-90a1-940dae9a2a88 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f2289729-dc0b-4d80-90a1-940dae9a2a88 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f2289729-dc0b-4d80-90a1-940dae9a2a88 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f2289729-dc0b-4d80-90a1-940dae9a2a88 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f2289729-dc0b-4d80-90a1-940dae9a2a88 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:07 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-f2289729-dc0b-4d80-90a1-940dae9a2a88 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] HTTP exception thrown: Instance 06ecf305-65ca-4752-984c-cb7094593493 could not be found. Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f2289729-dc0b-4d80-90a1-940dae9a2a88 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Request method failure captured: Apr 13 23:11:07 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/06ecf305-65ca-4752-984c-cb7094593493 HTTP/1.1 Apr 13 23:11:07 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:11:07 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:11:07 user devstack@n-api.service[61611]: Connection: close Apr 13 23:11:07 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:11:07 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:11:07 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:11:07 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:11:07 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:11:07 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIgE6Gl7ZSFkA-_Uvg9_1wPLldz_ScwHJLtH7XfCRP3AC2MJmMpZ7l9bcSBPK09rKumFcFKFuRTWt2Sf1d4N5k3NQaJGxn8JzsH44PLD5fzCs7WE6phnuUwwFlbCj4pm_qJgudGzAbO1tRiQjdcyEvfY3Ke0cXzXFHfEZxyouzAaMTk Apr 13 23:11:07 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:11:07 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:11:07 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:11:07 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:11:07 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:11:07 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:11:07 user devstack@n-api.service[61611]: X-Project-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:11:07 user devstack@n-api.service[61611]: X-Project-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:11:07 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:11:07 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:11:07 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d872848d5dc1471996e2f33bbbdebbd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:11:07 user devstack@n-api.service[61611]: X-Tenant: tempest-TestVolumeBootPattern-751187467 Apr 13 23:11:07 user devstack@n-api.service[61611]: X-Tenant-Id: d872848d5dc1471996e2f33bbbdebbd9 Apr 13 23:11:07 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-TestVolumeBootPattern-751187467 Apr 13 23:11:07 user devstack@n-api.service[61611]: X-User: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:11:07 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:11:07 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:11:07 user devstack@n-api.service[61611]: X-User-Id: b289294050af4c41aeef8401832487a1 Apr 13 23:11:07 user devstack@n-api.service[61611]: X-User-Name: tempest-TestVolumeBootPattern-751187467-project-member Apr 13 23:11:07 user devstack@n-api.service[61611]: method: > Apr 13 23:11:07 user devstack@n-api.service[61611]: exception: Instance 06ecf305-65ca-4752-984c-cb7094593493 could not be found. Apr 13 23:11:07 user devstack@n-api.service[61611]: action_args: {'id': '06ecf305-65ca-4752-984c-cb7094593493'} Apr 13 23:11:07 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06ecf305-65ca-4752-984c-cb7094593493 could not be found. Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06ecf305-65ca-4752-984c-cb7094593493 could not be found. Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06ecf305-65ca-4752-984c-cb7094593493 could not be found. Apr 13 23:11:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:11:07 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f2289729-dc0b-4d80-90a1-940dae9a2a88 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Returning 404 to user: Instance 06ecf305-65ca-4752-984c-cb7094593493 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:11:07 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f2289729-dc0b-4d80-90a1-940dae9a2a88 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06ecf305-65ca-4752-984c-cb7094593493" status: 404 len: 111 microversion: 2.1 time: 0.055918 Apr 13 23:11:07 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 276/834] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:11:07 2023] GET /compute/v2.1/servers/06ecf305-65ca-4752-984c-cb7094593493 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:11:07 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-f6437d3d-981d-4907-901e-ab914f89c8f5 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:11:07 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-f6437d3d-981d-4907-901e-ab914f89c8f5 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:11:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f6437d3d-981d-4907-901e-ab914f89c8f5 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f6437d3d-981d-4907-901e-ab914f89c8f5 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f6437d3d-981d-4907-901e-ab914f89c8f5 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f6437d3d-981d-4907-901e-ab914f89c8f5 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f6437d3d-981d-4907-901e-ab914f89c8f5 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f6437d3d-981d-4907-901e-ab914f89c8f5 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:07 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-f6437d3d-981d-4907-901e-ab914f89c8f5 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:11:07 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-f6437d3d-981d-4907-901e-ab914f89c8f5 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1657 microversion: 2.1 time: 0.220413 Apr 13 23:11:07 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 282/835] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:11:07 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1657 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:11:07 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e6ecd5a-e404-40a1-b361-bb3f3c3644ac"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:07 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:11:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:08 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329856 Apr 13 23:11:08 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 278/836] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 23:11:07 2023] POST /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:11:10 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-f0a4b21d-6d44-4dc1-bc40-2dfe41947879 req-b4f8ddc4-9fc7-4a59-8ee2-7625a33a6c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6969342-d92d-4841-99a5-466d2eff89c2", "tag": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f0a4b21d-6d44-4dc1-bc40-2dfe41947879 req-b4f8ddc4-9fc7-4a59-8ee2-7625a33a6c2b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f0a4b21d-6d44-4dc1-bc40-2dfe41947879 req-b4f8ddc4-9fc7-4a59-8ee2-7625a33a6c2b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f0a4b21d-6d44-4dc1-bc40-2dfe41947879 req-b4f8ddc4-9fc7-4a59-8ee2-7625a33a6c2b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:10 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-f0a4b21d-6d44-4dc1-bc40-2dfe41947879 req-b4f8ddc4-9fc7-4a59-8ee2-7625a33a6c2b service nova] Creating event network-changed:4df820e6-69a5-4b4e-a43c-bbbcbd66c02c for instance d6969342-d92d-4841-99a5-466d2eff89c2 on user Apr 13 23:11:10 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-f0a4b21d-6d44-4dc1-bc40-2dfe41947879 req-b4f8ddc4-9fc7-4a59-8ee2-7625a33a6c2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036212 Apr 13 23:11:10 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 277/837] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:11:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:11:10 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-2fa58778-d6fc-45b8-8faa-4689296ae3c3 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Calling method '.version_select at 0x7f3d1dd039a0>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:11:10 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-2fa58778-d6fc-45b8-8faa-4689296ae3c3 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-408481084" status: 202 len: 0 microversion: 2.1 time: 0.021423 Apr 13 23:11:10 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 283/838] 10.0.0.210 () {62 vars in 1337 bytes} [Thu Apr 13 23:11:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-408481084 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 23:11:12 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-39efa7ea-932d-4bab-9d19-fb93c16679ac req-abfae4c0-aa8b-46ae-9e1f-7a91c0189db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6969342-d92d-4841-99a5-466d2eff89c2", "name": "network-vif-plugged", "status": "completed", "tag": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-39efa7ea-932d-4bab-9d19-fb93c16679ac req-abfae4c0-aa8b-46ae-9e1f-7a91c0189db7 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-39efa7ea-932d-4bab-9d19-fb93c16679ac req-abfae4c0-aa8b-46ae-9e1f-7a91c0189db7 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-39efa7ea-932d-4bab-9d19-fb93c16679ac req-abfae4c0-aa8b-46ae-9e1f-7a91c0189db7 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:12 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-39efa7ea-932d-4bab-9d19-fb93c16679ac req-abfae4c0-aa8b-46ae-9e1f-7a91c0189db7 service nova] Creating event network-vif-plugged:4df820e6-69a5-4b4e-a43c-bbbcbd66c02c for instance d6969342-d92d-4841-99a5-466d2eff89c2 on user Apr 13 23:11:12 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-39efa7ea-932d-4bab-9d19-fb93c16679ac req-abfae4c0-aa8b-46ae-9e1f-7a91c0189db7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034427 Apr 13 23:11:12 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 279/839] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:11:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:11:14 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-d45a7b7e-0821-4f0d-8f07-6f8a8fbda293 req-8ee0d3fe-6907-4b75-9412-32f4ec534b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6969342-d92d-4841-99a5-466d2eff89c2", "name": "network-vif-plugged", "status": "completed", "tag": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:14 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:11:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d45a7b7e-0821-4f0d-8f07-6f8a8fbda293 req-8ee0d3fe-6907-4b75-9412-32f4ec534b2a service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d45a7b7e-0821-4f0d-8f07-6f8a8fbda293 req-8ee0d3fe-6907-4b75-9412-32f4ec534b2a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d45a7b7e-0821-4f0d-8f07-6f8a8fbda293 req-8ee0d3fe-6907-4b75-9412-32f4ec534b2a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:14 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:11:14 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-d45a7b7e-0821-4f0d-8f07-6f8a8fbda293 req-8ee0d3fe-6907-4b75-9412-32f4ec534b2a service nova] Creating event network-vif-plugged:4df820e6-69a5-4b4e-a43c-bbbcbd66c02c for instance d6969342-d92d-4841-99a5-466d2eff89c2 on user Apr 13 23:11:14 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-d45a7b7e-0821-4f0d-8f07-6f8a8fbda293 req-8ee0d3fe-6907-4b75-9412-32f4ec534b2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040250 Apr 13 23:11:14 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 278/840] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:11:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:11:15 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-d254f439-a0c4-4b11-a0a3-cc5a778dd1c0 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:11:15 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-d254f439-a0c4-4b11-a0a3-cc5a778dd1c0 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:11:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d254f439-a0c4-4b11-a0a3-cc5a778dd1c0 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d254f439-a0c4-4b11-a0a3-cc5a778dd1c0 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d254f439-a0c4-4b11-a0a3-cc5a778dd1c0 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d254f439-a0c4-4b11-a0a3-cc5a778dd1c0 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d254f439-a0c4-4b11-a0a3-cc5a778dd1c0 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d254f439-a0c4-4b11-a0a3-cc5a778dd1c0 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:16 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-d254f439-a0c4-4b11-a0a3-cc5a778dd1c0 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:11:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-d254f439-a0c4-4b11-a0a3-cc5a778dd1c0 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1703 microversion: 2.1 time: 0.148906 Apr 13 23:11:16 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 284/841] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:11:15 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1703 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-19843969", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=21 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting quotas for project 68330047a5fd4e4397cf5edca18c5b51. Resources: dict_keys(['metadata_items']) {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting quotas for user 59b2c11a23384f678a086de89139497d and project 68330047a5fd4e4397cf5edca18c5b51. Resources: dict_keys(['metadata_items']) {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:16 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/action" status: 202 len: 1157 microversion: 2.1 time: 0.396127 Apr 13 23:11:16 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 280/842] 10.0.0.210 () {64 vars in 1356 bytes} [Thu Apr 13 23:11:16 2023] POST /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/action => generated 1157 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 13 23:11:16 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f0ca1c0c-c7f2-43ed-90b9-94eca38b15f8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:11:16 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f0ca1c0c-c7f2-43ed-90b9-94eca38b15f8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:11:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0ca1c0c-c7f2-43ed-90b9-94eca38b15f8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0ca1c0c-c7f2-43ed-90b9-94eca38b15f8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0ca1c0c-c7f2-43ed-90b9-94eca38b15f8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0ca1c0c-c7f2-43ed-90b9-94eca38b15f8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0ca1c0c-c7f2-43ed-90b9-94eca38b15f8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0ca1c0c-c7f2-43ed-90b9-94eca38b15f8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:16 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-f0ca1c0c-c7f2-43ed-90b9-94eca38b15f8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:11:16 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f0ca1c0c-c7f2-43ed-90b9-94eca38b15f8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1729 microversion: 2.1 time: 0.298044 Apr 13 23:11:16 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 279/843] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:11:16 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1729 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:11:17 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-8f88cc53-884f-4f1b-8c32-9da16dc28021 req-c00e5503-ba97-4858-a82c-02452b8abed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d", "name": "network-vif-unplugged", "status": "completed", "tag": "09cc0c17-bd49-4207-9de4-89178a1e681e"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8f88cc53-884f-4f1b-8c32-9da16dc28021 req-c00e5503-ba97-4858-a82c-02452b8abed5 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8f88cc53-884f-4f1b-8c32-9da16dc28021 req-c00e5503-ba97-4858-a82c-02452b8abed5 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8f88cc53-884f-4f1b-8c32-9da16dc28021 req-c00e5503-ba97-4858-a82c-02452b8abed5 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:17 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-8f88cc53-884f-4f1b-8c32-9da16dc28021 req-c00e5503-ba97-4858-a82c-02452b8abed5 service nova] Creating event network-vif-unplugged:09cc0c17-bd49-4207-9de4-89178a1e681e for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d on user Apr 13 23:11:17 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-8f88cc53-884f-4f1b-8c32-9da16dc28021 req-c00e5503-ba97-4858-a82c-02452b8abed5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045789 Apr 13 23:11:17 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 285/844] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:11:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:11:18 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1939537437", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "networks": [{"uuid": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe"}]}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:18 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:11:18 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] validate_networks() for [('005b22e6-73d8-42f9-bd5c-8d4aad956bfe', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:11:19 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-5b23acda-92d3-4237-b8af-05d3972fc717 req-930cad4e-f022-415a-95f7-6261220d4676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d", "name": "network-vif-plugged", "status": "completed", "tag": "09cc0c17-bd49-4207-9de4-89178a1e681e"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:19 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:11:19 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:11:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5b23acda-92d3-4237-b8af-05d3972fc717 req-930cad4e-f022-415a-95f7-6261220d4676 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5b23acda-92d3-4237-b8af-05d3972fc717 req-930cad4e-f022-415a-95f7-6261220d4676 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5b23acda-92d3-4237-b8af-05d3972fc717 req-930cad4e-f022-415a-95f7-6261220d4676 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-5b23acda-92d3-4237-b8af-05d3972fc717 req-930cad4e-f022-415a-95f7-6261220d4676 service nova] Creating event network-vif-plugged:09cc0c17-bd49-4207-9de4-89178a1e681e for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d on user Apr 13 23:11:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-5b23acda-92d3-4237-b8af-05d3972fc717 req-930cad4e-f022-415a-95f7-6261220d4676 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050647 Apr 13 23:11:19 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 280/845] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:11:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:11:19 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:11:19 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:11:19 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:11:19 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:11:19 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:11:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:19 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Getting quotas for project 5cebfec442634e41b173904833269463. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:11:19 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Getting quotas for user 5a1420e7febd479e8f23ad9784950f65 and project 5cebfec442634e41b173904833269463. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:11:19 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:11:19 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:11:19 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.724201 Apr 13 23:11:19 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 281/846] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:11:18 2023] POST /compute/v2.1/servers => generated 378 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:11:19 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-d27d1080-d37e-4ce7-b895-45a9f6ded590 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:11:19 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-d27d1080-d37e-4ce7-b895-45a9f6ded590 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:11:19 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-d27d1080-d37e-4ce7-b895-45a9f6ded590 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1420e7febd479e8f23ad9784950f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cebfec442634e41b173904833269463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:11:19 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-d27d1080-d37e-4ce7-b895-45a9f6ded590 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0b702ab-bc03-49c0-9ae6-376e9276f717" status: 200 len: 1213 microversion: 2.1 time: 0.078168 Apr 13 23:11:19 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 286/847] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:11:19 2023] GET /compute/v2.1/servers/d0b702ab-bc03-49c0-9ae6-376e9276f717 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 23:11:22 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-29da2b02-0b5e-47e1-a2f9-4088c4e17072 req-832dd8e8-e792-4486-8a70-7c20d570f18b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0b702ab-bc03-49c0-9ae6-376e9276f717", "tag": "ce4496b6-af8d-489a-86cb-963886c9d30c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-29da2b02-0b5e-47e1-a2f9-4088c4e17072 req-832dd8e8-e792-4486-8a70-7c20d570f18b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-29da2b02-0b5e-47e1-a2f9-4088c4e17072 req-832dd8e8-e792-4486-8a70-7c20d570f18b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-29da2b02-0b5e-47e1-a2f9-4088c4e17072 req-832dd8e8-e792-4486-8a70-7c20d570f18b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:22 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-29da2b02-0b5e-47e1-a2f9-4088c4e17072 req-832dd8e8-e792-4486-8a70-7c20d570f18b service nova] Creating event network-changed:ce4496b6-af8d-489a-86cb-963886c9d30c for instance d0b702ab-bc03-49c0-9ae6-376e9276f717 on user Apr 13 23:11:22 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-29da2b02-0b5e-47e1-a2f9-4088c4e17072 req-832dd8e8-e792-4486-8a70-7c20d570f18b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027714 Apr 13 23:11:22 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 281/848] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:11:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:11:25 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-219a4f45-5afe-4ead-a697-cbcf8da4412f req-2aa59e1b-47b5-4eee-a606-df9ed310fbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b702ab-bc03-49c0-9ae6-376e9276f717", "name": "network-vif-plugged", "status": "completed", "tag": "ce4496b6-af8d-489a-86cb-963886c9d30c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-219a4f45-5afe-4ead-a697-cbcf8da4412f req-2aa59e1b-47b5-4eee-a606-df9ed310fbf9 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-219a4f45-5afe-4ead-a697-cbcf8da4412f req-2aa59e1b-47b5-4eee-a606-df9ed310fbf9 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-219a4f45-5afe-4ead-a697-cbcf8da4412f req-2aa59e1b-47b5-4eee-a606-df9ed310fbf9 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:25 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-219a4f45-5afe-4ead-a697-cbcf8da4412f req-2aa59e1b-47b5-4eee-a606-df9ed310fbf9 service nova] Creating event network-vif-plugged:ce4496b6-af8d-489a-86cb-963886c9d30c for instance d0b702ab-bc03-49c0-9ae6-376e9276f717 on user Apr 13 23:11:25 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-219a4f45-5afe-4ead-a697-cbcf8da4412f req-2aa59e1b-47b5-4eee-a606-df9ed310fbf9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040721 Apr 13 23:11:25 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 282/849] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:11:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 23:11:27 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-6b34e203-4b60-4699-a25d-3ae93e0162ac req-5bc41395-7234-4517-bc43-53de9467de91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b702ab-bc03-49c0-9ae6-376e9276f717", "name": "network-vif-plugged", "status": "completed", "tag": "ce4496b6-af8d-489a-86cb-963886c9d30c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:27 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=28 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:11:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6b34e203-4b60-4699-a25d-3ae93e0162ac req-5bc41395-7234-4517-bc43-53de9467de91 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6b34e203-4b60-4699-a25d-3ae93e0162ac req-5bc41395-7234-4517-bc43-53de9467de91 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6b34e203-4b60-4699-a25d-3ae93e0162ac req-5bc41395-7234-4517-bc43-53de9467de91 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:27 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-6b34e203-4b60-4699-a25d-3ae93e0162ac req-5bc41395-7234-4517-bc43-53de9467de91 service nova] Creating event network-vif-plugged:ce4496b6-af8d-489a-86cb-963886c9d30c for instance d0b702ab-bc03-49c0-9ae6-376e9276f717 on user Apr 13 23:11:27 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-6b34e203-4b60-4699-a25d-3ae93e0162ac req-5bc41395-7234-4517-bc43-53de9467de91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041609 Apr 13 23:11:27 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 287/850] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:11:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:11:28 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-764cbf7a-9e5f-43fb-8e8a-53a18c05c4b2 req-9ab43657-8aba-4afe-b959-8b62f8e54f30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d", "name": "network-vif-plugged", "status": "completed", "tag": "09cc0c17-bd49-4207-9de4-89178a1e681e"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-764cbf7a-9e5f-43fb-8e8a-53a18c05c4b2 req-9ab43657-8aba-4afe-b959-8b62f8e54f30 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-764cbf7a-9e5f-43fb-8e8a-53a18c05c4b2 req-9ab43657-8aba-4afe-b959-8b62f8e54f30 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-764cbf7a-9e5f-43fb-8e8a-53a18c05c4b2 req-9ab43657-8aba-4afe-b959-8b62f8e54f30 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:28 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-764cbf7a-9e5f-43fb-8e8a-53a18c05c4b2 req-9ab43657-8aba-4afe-b959-8b62f8e54f30 service nova] Creating event network-vif-plugged:09cc0c17-bd49-4207-9de4-89178a1e681e for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d on user Apr 13 23:11:28 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-764cbf7a-9e5f-43fb-8e8a-53a18c05c4b2 req-9ab43657-8aba-4afe-b959-8b62f8e54f30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049450 Apr 13 23:11:28 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 282/851] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:11:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:11:30 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:11:30 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:11:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-b2ee2df8-02d7-4a98-83b6-b5ea808ae2f9 req-7947ba1a-6a8f-43dc-b2d8-0cfba5bbea6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d", "name": "network-vif-plugged", "status": "completed", "tag": "09cc0c17-bd49-4207-9de4-89178a1e681e"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:30 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b2ee2df8-02d7-4a98-83b6-b5ea808ae2f9 req-7947ba1a-6a8f-43dc-b2d8-0cfba5bbea6b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:30 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b2ee2df8-02d7-4a98-83b6-b5ea808ae2f9 req-7947ba1a-6a8f-43dc-b2d8-0cfba5bbea6b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:30 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b2ee2df8-02d7-4a98-83b6-b5ea808ae2f9 req-7947ba1a-6a8f-43dc-b2d8-0cfba5bbea6b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:30 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-b2ee2df8-02d7-4a98-83b6-b5ea808ae2f9 req-7947ba1a-6a8f-43dc-b2d8-0cfba5bbea6b service nova] Creating event network-vif-plugged:09cc0c17-bd49-4207-9de4-89178a1e681e for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d on user Apr 13 23:11:30 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-b2ee2df8-02d7-4a98-83b6-b5ea808ae2f9 req-7947ba1a-6a8f-43dc-b2d8-0cfba5bbea6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039032 Apr 13 23:11:30 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 283/852] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:11:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:11:38 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:11:38 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:11:38 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:11:38 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5c2698f6-f01e-47aa-be2a-764608424bca tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:11:38 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-5c2698f6-f01e-47aa-be2a-764608424bca tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:11:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5c2698f6-f01e-47aa-be2a-764608424bca tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5c2698f6-f01e-47aa-be2a-764608424bca tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5c2698f6-f01e-47aa-be2a-764608424bca tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5c2698f6-f01e-47aa-be2a-764608424bca tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5c2698f6-f01e-47aa-be2a-764608424bca tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5c2698f6-f01e-47aa-be2a-764608424bca tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:38 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-5c2698f6-f01e-47aa-be2a-764608424bca tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6385ae82042ad9682f7728b8263da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f4ef55afe342ebb945ad336e01582a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:11:38 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-5c2698f6-f01e-47aa-be2a-764608424bca tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7" status: 200 len: 1567 microversion: 2.1 time: 0.212759 Apr 13 23:11:38 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 288/853] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:11:38 2023] GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7 => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:11:44 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=9 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:11:44 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=13 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:11:44 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-6084b504-ebf2-49f6-88aa-755870e2172d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:44 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-6084b504-ebf2-49f6-88aa-755870e2172d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:11:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6084b504-ebf2-49f6-88aa-755870e2172d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6084b504-ebf2-49f6-88aa-755870e2172d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6084b504-ebf2-49f6-88aa-755870e2172d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6084b504-ebf2-49f6-88aa-755870e2172d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6084b504-ebf2-49f6-88aa-755870e2172d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6084b504-ebf2-49f6-88aa-755870e2172d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:44 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-6084b504-ebf2-49f6-88aa-755870e2172d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962/action" status: 202 len: 0 microversion: 2.87 time: 0.105994 Apr 13 23:11:44 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 283/854] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 23:11:44 2023] POST /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:11:44 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:11:44 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:DELETE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:11:44 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-47441e2b-e629-481b-82f7-8f33c5b0798e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:11:44 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-47441e2b-e629-481b-82f7-8f33c5b0798e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:11:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-47441e2b-e629-481b-82f7-8f33c5b0798e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-47441e2b-e629-481b-82f7-8f33c5b0798e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-47441e2b-e629-481b-82f7-8f33c5b0798e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-47441e2b-e629-481b-82f7-8f33c5b0798e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-47441e2b-e629-481b-82f7-8f33c5b0798e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-47441e2b-e629-481b-82f7-8f33c5b0798e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:44 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-47441e2b-e629-481b-82f7-8f33c5b0798e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:11:44 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-47441e2b-e629-481b-82f7-8f33c5b0798e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:11:44 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-47441e2b-e629-481b-82f7-8f33c5b0798e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:11:44 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-47441e2b-e629-481b-82f7-8f33c5b0798e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962" status: 200 len: 1762 microversion: 2.87 time: 0.258998 Apr 13 23:11:44 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 284/855] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:11:44 2023] GET /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962 => generated 1762 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:11:45 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-78cfe71a-50a8-4f0b-9a97-af4c57a92e37 req-25a3ab9a-88d3-4865-bc91-8109f48c3165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e9744c-04d3-486e-b032-90c672927962", "name": "network-vif-unplugged", "status": "completed", "tag": "7ae6b103-e1c6-42e6-9fcd-e76353955a76"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:45 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-78cfe71a-50a8-4f0b-9a97-af4c57a92e37 req-25a3ab9a-88d3-4865-bc91-8109f48c3165 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:45 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-78cfe71a-50a8-4f0b-9a97-af4c57a92e37 req-25a3ab9a-88d3-4865-bc91-8109f48c3165 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:45 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-78cfe71a-50a8-4f0b-9a97-af4c57a92e37 req-25a3ab9a-88d3-4865-bc91-8109f48c3165 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:45 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-78cfe71a-50a8-4f0b-9a97-af4c57a92e37 req-25a3ab9a-88d3-4865-bc91-8109f48c3165 service nova] Creating event network-vif-unplugged:7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance a9e9744c-04d3-486e-b032-90c672927962 on user Apr 13 23:11:45 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-78cfe71a-50a8-4f0b-9a97-af4c57a92e37 req-25a3ab9a-88d3-4865-bc91-8109f48c3165 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031695 Apr 13 23:11:45 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 289/856] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:11:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:11:47 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-030fd457-f453-4433-aca5-20337d06f9da req-8495cc27-4fb7-4ec0-9442-1339f0442183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e9744c-04d3-486e-b032-90c672927962", "name": "network-vif-plugged", "status": "completed", "tag": "7ae6b103-e1c6-42e6-9fcd-e76353955a76"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-030fd457-f453-4433-aca5-20337d06f9da req-8495cc27-4fb7-4ec0-9442-1339f0442183 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-030fd457-f453-4433-aca5-20337d06f9da req-8495cc27-4fb7-4ec0-9442-1339f0442183 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-030fd457-f453-4433-aca5-20337d06f9da req-8495cc27-4fb7-4ec0-9442-1339f0442183 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:47 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-030fd457-f453-4433-aca5-20337d06f9da req-8495cc27-4fb7-4ec0-9442-1339f0442183 service nova] Creating event network-vif-plugged:7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance a9e9744c-04d3-486e-b032-90c672927962 on user Apr 13 23:11:47 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-030fd457-f453-4433-aca5-20337d06f9da req-8495cc27-4fb7-4ec0-9442-1339f0442183 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038747 Apr 13 23:11:47 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 284/857] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:11:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:11:49 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-8c0058d8-650c-486e-aa1c-f6e57776e8ee req-9039be6f-ab9e-4bca-afa8-80f8ad69624b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e9744c-04d3-486e-b032-90c672927962", "name": "network-vif-plugged", "status": "completed", "tag": "7ae6b103-e1c6-42e6-9fcd-e76353955a76"}, {"server_uuid": "a9e9744c-04d3-486e-b032-90c672927962", "name": "network-vif-plugged", "status": "completed", "tag": "7ae6b103-e1c6-42e6-9fcd-e76353955a76"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:11:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-8c0058d8-650c-486e-aa1c-f6e57776e8ee req-9039be6f-ab9e-4bca-afa8-80f8ad69624b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-8c0058d8-650c-486e-aa1c-f6e57776e8ee req-9039be6f-ab9e-4bca-afa8-80f8ad69624b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-8c0058d8-650c-486e-aa1c-f6e57776e8ee req-9039be6f-ab9e-4bca-afa8-80f8ad69624b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:49 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-8c0058d8-650c-486e-aa1c-f6e57776e8ee req-9039be6f-ab9e-4bca-afa8-80f8ad69624b service nova] Creating event network-vif-plugged:7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance a9e9744c-04d3-486e-b032-90c672927962 on user Apr 13 23:11:49 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-8c0058d8-650c-486e-aa1c-f6e57776e8ee req-9039be6f-ab9e-4bca-afa8-80f8ad69624b service nova] Creating event network-vif-plugged:7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance a9e9744c-04d3-486e-b032-90c672927962 on user Apr 13 23:11:49 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-8c0058d8-650c-486e-aa1c-f6e57776e8ee req-9039be6f-ab9e-4bca-afa8-80f8ad69624b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037641 Apr 13 23:11:49 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 285/858] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:11:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 23:11:50 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e82b1354-5fd6-4432-9027-f09209b82197 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:11:50 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-e82b1354-5fd6-4432-9027-f09209b82197 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:11:50 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e82b1354-5fd6-4432-9027-f09209b82197 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:50 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e82b1354-5fd6-4432-9027-f09209b82197 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:50 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e82b1354-5fd6-4432-9027-f09209b82197 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:50 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e82b1354-5fd6-4432-9027-f09209b82197 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:50 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e82b1354-5fd6-4432-9027-f09209b82197 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:50 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e82b1354-5fd6-4432-9027-f09209b82197 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:50 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-e82b1354-5fd6-4432-9027-f09209b82197 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] HTTP exception thrown: Instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 could not be found. Apr 13 23:11:50 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e82b1354-5fd6-4432-9027-f09209b82197 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Request method failure captured: Apr 13 23:11:50 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/dc473fb8-e574-4e49-b860-3ae0066cc9b8 HTTP/1.1 Apr 13 23:11:50 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:11:50 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:11:50 user devstack@n-api.service[61613]: Connection: close Apr 13 23:11:50 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:11:50 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:11:50 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:11:50 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:11:50 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:11:50 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIn1WpkCHTcQ3vsm6vuXvLMwBukWR3T78fUteB1g1zobAkavXEwqiMsjm9a7O1wQSAPbhSneJ4g36HRneth-jvcWNhT4bg4W3DOs07jcjQHnm6EdcnPlV6wX56fpXkxsD2Vss9a8TpT8oI4bKWdzWDXg8gRXoxb6iO_eerJkHkQeHrY Apr 13 23:11:50 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:11:50 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:11:50 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:11:50 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:11:50 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:11:50 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:11:50 user devstack@n-api.service[61613]: X-Project-Id: d8a3c684b0414336b2ca770eb1f3ab17 Apr 13 23:11:50 user devstack@n-api.service[61613]: X-Project-Name: tempest-ServersNegativeTestJSON-1433854176 Apr 13 23:11:50 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:11:50 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:11:50 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d8a3c684b0414336b2ca770eb1f3ab17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8a3c684b0414336b2ca770eb1f3ab17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8a3c684b0414336b2ca770eb1f3ab17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:11:50 user devstack@n-api.service[61613]: X-Tenant: tempest-ServersNegativeTestJSON-1433854176 Apr 13 23:11:50 user devstack@n-api.service[61613]: X-Tenant-Id: d8a3c684b0414336b2ca770eb1f3ab17 Apr 13 23:11:50 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1433854176 Apr 13 23:11:50 user devstack@n-api.service[61613]: X-User: tempest-ServersNegativeTestJSON-1433854176-project-member Apr 13 23:11:50 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:11:50 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:11:50 user devstack@n-api.service[61613]: X-User-Id: 71593deacbd74fea9fc2faf5a9b08877 Apr 13 23:11:50 user devstack@n-api.service[61613]: X-User-Name: tempest-ServersNegativeTestJSON-1433854176-project-member Apr 13 23:11:50 user devstack@n-api.service[61613]: method: > Apr 13 23:11:50 user devstack@n-api.service[61613]: exception: Instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 could not be found. Apr 13 23:11:50 user devstack@n-api.service[61613]: action_args: {'id': 'dc473fb8-e574-4e49-b860-3ae0066cc9b8'} Apr 13 23:11:50 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 could not be found. Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 could not be found. Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 could not be found. Apr 13 23:11:50 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:11:50 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e82b1354-5fd6-4432-9027-f09209b82197 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Returning 404 to user: Instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:11:50 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-e82b1354-5fd6-4432-9027-f09209b82197 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc473fb8-e574-4e49-b860-3ae0066cc9b8" status: 404 len: 111 microversion: 2.1 time: 0.028973 Apr 13 23:11:50 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 290/859] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:11:50 2023] GET /compute/v2.1/servers/dc473fb8-e574-4e49-b860-3ae0066cc9b8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:11:57 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-cda49afc-ce6a-4696-80b4-4cbe35339594 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:11:57 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-cda49afc-ce6a-4696-80b4-4cbe35339594 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:11:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cda49afc-ce6a-4696-80b4-4cbe35339594 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cda49afc-ce6a-4696-80b4-4cbe35339594 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cda49afc-ce6a-4696-80b4-4cbe35339594 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cda49afc-ce6a-4696-80b4-4cbe35339594 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:11:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cda49afc-ce6a-4696-80b4-4cbe35339594 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:11:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cda49afc-ce6a-4696-80b4-4cbe35339594 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:11:57 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-cda49afc-ce6a-4696-80b4-4cbe35339594 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c235879bc444a819061c4bb4bf3441b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6455f36704e4b3088d8a9114b087fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:11:57 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-cda49afc-ce6a-4696-80b4-4cbe35339594 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6969342-d92d-4841-99a5-466d2eff89c2" status: 200 len: 1486 microversion: 2.1 time: 0.175795 Apr 13 23:11:57 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 285/860] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:11:57 2023] GET /compute/v2.1/servers/d6969342-d92d-4841-99a5-466d2eff89c2 => generated 1486 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:12:06 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:12:06 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=8 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:12:06 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-72ed0ea1-82cb-464e-959e-29c2dc58389e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:12:06 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-72ed0ea1-82cb-464e-959e-29c2dc58389e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:12:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-72ed0ea1-82cb-464e-959e-29c2dc58389e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:12:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-72ed0ea1-82cb-464e-959e-29c2dc58389e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:12:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-72ed0ea1-82cb-464e-959e-29c2dc58389e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:12:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-72ed0ea1-82cb-464e-959e-29c2dc58389e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:12:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-72ed0ea1-82cb-464e-959e-29c2dc58389e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:12:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-72ed0ea1-82cb-464e-959e-29c2dc58389e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:12:07 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-72ed0ea1-82cb-464e-959e-29c2dc58389e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:12:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-72ed0ea1-82cb-464e-959e-29c2dc58389e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1720 microversion: 2.1 time: 0.216424 Apr 13 23:12:07 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 286/861] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:12:06 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1720 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:12:09 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-3c237862-873e-4972-9a49-78713eeb0a58 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:12:09 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-3c237862-873e-4972-9a49-78713eeb0a58 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:12:09 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:12:09 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=10 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:12:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3c237862-873e-4972-9a49-78713eeb0a58 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:12:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3c237862-873e-4972-9a49-78713eeb0a58 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:12:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3c237862-873e-4972-9a49-78713eeb0a58 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:12:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3c237862-873e-4972-9a49-78713eeb0a58 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:12:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3c237862-873e-4972-9a49-78713eeb0a58 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:12:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3c237862-873e-4972-9a49-78713eeb0a58 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:12:09 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-3c237862-873e-4972-9a49-78713eeb0a58 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1420e7febd479e8f23ad9784950f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cebfec442634e41b173904833269463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:12:09 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-3c237862-873e-4972-9a49-78713eeb0a58 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0b702ab-bc03-49c0-9ae6-376e9276f717" status: 200 len: 1496 microversion: 2.1 time: 0.158018 Apr 13 23:12:09 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 291/862] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:12:09 2023] GET /compute/v2.1/servers/d0b702ab-bc03-49c0-9ae6-376e9276f717 => generated 1496 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:12:34 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-6962017d-2766-44bc-b480-558fe2f7e7ff tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:12:34 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-6962017d-2766-44bc-b480-558fe2f7e7ff tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:12:34 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:12:34 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:12:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6962017d-2766-44bc-b480-558fe2f7e7ff tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:12:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6962017d-2766-44bc-b480-558fe2f7e7ff tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:12:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6962017d-2766-44bc-b480-558fe2f7e7ff tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:12:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6962017d-2766-44bc-b480-558fe2f7e7ff tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:12:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6962017d-2766-44bc-b480-558fe2f7e7ff tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:12:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6962017d-2766-44bc-b480-558fe2f7e7ff tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:12:35 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-6962017d-2766-44bc-b480-558fe2f7e7ff tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:12:35 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-6962017d-2766-44bc-b480-558fe2f7e7ff tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:12:35 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-6962017d-2766-44bc-b480-558fe2f7e7ff tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:12:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-6962017d-2766-44bc-b480-558fe2f7e7ff tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962" status: 200 len: 1768 microversion: 2.87 time: 0.232177 Apr 13 23:12:35 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 286/863] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:12:34 2023] GET /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962 => generated 1768 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:12:38 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-1b92d92b-d1fe-4320-9f38-b23fd13868ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:12:38 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-1b92d92b-d1fe-4320-9f38-b23fd13868ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:12:38 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:12:38 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:12:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b92d92b-d1fe-4320-9f38-b23fd13868ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:12:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b92d92b-d1fe-4320-9f38-b23fd13868ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:12:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b92d92b-d1fe-4320-9f38-b23fd13868ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:12:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b92d92b-d1fe-4320-9f38-b23fd13868ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:12:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b92d92b-d1fe-4320-9f38-b23fd13868ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:12:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b92d92b-d1fe-4320-9f38-b23fd13868ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:12:38 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-1b92d92b-d1fe-4320-9f38-b23fd13868ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6385ae82042ad9682f7728b8263da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f4ef55afe342ebb945ad336e01582a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:12:38 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-1b92d92b-d1fe-4320-9f38-b23fd13868ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7" status: 200 len: 1567 microversion: 2.1 time: 0.155356 Apr 13 23:12:38 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 287/864] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:12:38 2023] GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:12:42 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-6c8597b6-b56a-4d06-81fd-a616cecc2029 req-29bbd704-9d97-4670-9be8-dad78f72ec52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9de39303-da44-47ae-adef-ff80f0b792a7", "tag": "16379ba5-9e41-4846-9ac8-8b5e86b776c0"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:12:42 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:12:42 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:12:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6c8597b6-b56a-4d06-81fd-a616cecc2029 req-29bbd704-9d97-4670-9be8-dad78f72ec52 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:12:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6c8597b6-b56a-4d06-81fd-a616cecc2029 req-29bbd704-9d97-4670-9be8-dad78f72ec52 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:12:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6c8597b6-b56a-4d06-81fd-a616cecc2029 req-29bbd704-9d97-4670-9be8-dad78f72ec52 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:12:42 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-6c8597b6-b56a-4d06-81fd-a616cecc2029 req-29bbd704-9d97-4670-9be8-dad78f72ec52 service nova] Creating event network-changed:16379ba5-9e41-4846-9ac8-8b5e86b776c0 for instance 9de39303-da44-47ae-adef-ff80f0b792a7 on user Apr 13 23:12:42 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-6c8597b6-b56a-4d06-81fd-a616cecc2029 req-29bbd704-9d97-4670-9be8-dad78f72ec52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038345 Apr 13 23:12:42 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 292/865] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:12:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:12:43 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:12:43 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:12:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:12:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:12:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:12:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:12:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:12:43 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:12:43 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322505 Apr 13 23:12:43 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 287/866] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 23:12:43 2023] POST /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:12:58 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:12:58 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:12:58 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:12:58 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:12:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:12:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:12:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:12:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:12:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:12:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:12:58 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Going to try to terminate instance {{(pid=61612) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:12:58 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d6969342-d92d-4841-99a5-466d2eff89c2" status: 204 len: 0 microversion: 2.1 time: 0.131875 Apr 13 23:12:58 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 288/867] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:12:58 2023] DELETE /compute/v2.1/servers/d6969342-d92d-4841-99a5-466d2eff89c2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:12:58 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:12:58 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:12:58 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-70d2f9d8-7524-432a-b9bf-c902d590f3a8 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:12:58 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-70d2f9d8-7524-432a-b9bf-c902d590f3a8 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:12:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-70d2f9d8-7524-432a-b9bf-c902d590f3a8 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:12:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-70d2f9d8-7524-432a-b9bf-c902d590f3a8 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:12:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-70d2f9d8-7524-432a-b9bf-c902d590f3a8 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:12:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-70d2f9d8-7524-432a-b9bf-c902d590f3a8 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:12:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-70d2f9d8-7524-432a-b9bf-c902d590f3a8 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:12:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-70d2f9d8-7524-432a-b9bf-c902d590f3a8 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:12:58 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:12:58 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:12:58 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-7706278a-5b5d-41c7-a7b4-087ab8039f74 req-e5ffdd30-a3a9-4536-8359-e2d8eb35925f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6969342-d92d-4841-99a5-466d2eff89c2", "name": "network-vif-unplugged", "status": "completed", "tag": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:12:58 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-70d2f9d8-7524-432a-b9bf-c902d590f3a8 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c235879bc444a819061c4bb4bf3441b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6455f36704e4b3088d8a9114b087fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:12:58 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-70d2f9d8-7524-432a-b9bf-c902d590f3a8 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6969342-d92d-4841-99a5-466d2eff89c2" status: 200 len: 1492 microversion: 2.1 time: 0.276201 Apr 13 23:12:58 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 293/868] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:12:58 2023] GET /compute/v2.1/servers/d6969342-d92d-4841-99a5-466d2eff89c2 => generated 1492 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:12:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-7706278a-5b5d-41c7-a7b4-087ab8039f74 req-e5ffdd30-a3a9-4536-8359-e2d8eb35925f service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:12:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-7706278a-5b5d-41c7-a7b4-087ab8039f74 req-e5ffdd30-a3a9-4536-8359-e2d8eb35925f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:12:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-7706278a-5b5d-41c7-a7b4-087ab8039f74 req-e5ffdd30-a3a9-4536-8359-e2d8eb35925f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:12:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-7706278a-5b5d-41c7-a7b4-087ab8039f74 req-e5ffdd30-a3a9-4536-8359-e2d8eb35925f service nova] Creating event network-vif-unplugged:4df820e6-69a5-4b4e-a43c-bbbcbd66c02c for instance d6969342-d92d-4841-99a5-466d2eff89c2 on user Apr 13 23:12:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-7706278a-5b5d-41c7-a7b4-087ab8039f74 req-e5ffdd30-a3a9-4536-8359-e2d8eb35925f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055553 Apr 13 23:12:58 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 288/869] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:12:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:13:00 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-299565eb-9f0a-43c3-bacf-718c0efa34d9 req-de4b0016-3900-486f-9666-ea30ff84adf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6969342-d92d-4841-99a5-466d2eff89c2", "name": "network-vif-plugged", "status": "completed", "tag": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c"}, {"server_uuid": "d6969342-d92d-4841-99a5-466d2eff89c2", "name": "network-vif-deleted", "tag": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:13:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-299565eb-9f0a-43c3-bacf-718c0efa34d9 req-de4b0016-3900-486f-9666-ea30ff84adf9 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-299565eb-9f0a-43c3-bacf-718c0efa34d9 req-de4b0016-3900-486f-9666-ea30ff84adf9 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-299565eb-9f0a-43c3-bacf-718c0efa34d9 req-de4b0016-3900-486f-9666-ea30ff84adf9 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:00 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-299565eb-9f0a-43c3-bacf-718c0efa34d9 req-de4b0016-3900-486f-9666-ea30ff84adf9 service nova] Creating event network-vif-plugged:4df820e6-69a5-4b4e-a43c-bbbcbd66c02c for instance d6969342-d92d-4841-99a5-466d2eff89c2 on user Apr 13 23:13:00 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-299565eb-9f0a-43c3-bacf-718c0efa34d9 req-de4b0016-3900-486f-9666-ea30ff84adf9 service nova] Creating event network-vif-deleted:4df820e6-69a5-4b4e-a43c-bbbcbd66c02c for instance d6969342-d92d-4841-99a5-466d2eff89c2 on user Apr 13 23:13:00 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-299565eb-9f0a-43c3-bacf-718c0efa34d9 req-de4b0016-3900-486f-9666-ea30ff84adf9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032247 Apr 13 23:13:00 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 289/870] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:13:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:13:01 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:13:01 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:13:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:01 user devstack@n-api.service[61613]: DEBUG nova.objects.instance [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lazy-loading 'services' on Instance uuid 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=61613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:13:01 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments/dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0" status: 202 len: 0 microversion: 2.1 time: 0.166253 Apr 13 23:13:01 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 294/871] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 23:13:01 2023] DELETE /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments/dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:13:01 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5c5a487f-5f44-42ef-b3ea-f85ee19d12ed tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:13:01 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-5c5a487f-5f44-42ef-b3ea-f85ee19d12ed tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:13:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5c5a487f-5f44-42ef-b3ea-f85ee19d12ed tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5c5a487f-5f44-42ef-b3ea-f85ee19d12ed tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5c5a487f-5f44-42ef-b3ea-f85ee19d12ed tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5c5a487f-5f44-42ef-b3ea-f85ee19d12ed tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5c5a487f-5f44-42ef-b3ea-f85ee19d12ed tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5c5a487f-5f44-42ef-b3ea-f85ee19d12ed tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:01 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-5c5a487f-5f44-42ef-b3ea-f85ee19d12ed tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047667 Apr 13 23:13:01 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 289/872] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:13:01 2023] GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:13:07 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-8fa198df-9c05-4ab0-b02a-5f1928998e8c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:13:07 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-8fa198df-9c05-4ab0-b02a-5f1928998e8c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:13:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8fa198df-9c05-4ab0-b02a-5f1928998e8c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8fa198df-9c05-4ab0-b02a-5f1928998e8c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8fa198df-9c05-4ab0-b02a-5f1928998e8c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8fa198df-9c05-4ab0-b02a-5f1928998e8c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8fa198df-9c05-4ab0-b02a-5f1928998e8c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8fa198df-9c05-4ab0-b02a-5f1928998e8c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:07 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-8fa198df-9c05-4ab0-b02a-5f1928998e8c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:13:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-8fa198df-9c05-4ab0-b02a-5f1928998e8c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1720 microversion: 2.1 time: 0.442871 Apr 13 23:13:07 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 290/873] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:13:07 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1720 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:13:07 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-beccab6e-48c4-4fbd-b57e-abf8b58567e1 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:13:07 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-beccab6e-48c4-4fbd-b57e-abf8b58567e1 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:13:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-beccab6e-48c4-4fbd-b57e-abf8b58567e1 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-beccab6e-48c4-4fbd-b57e-abf8b58567e1 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-beccab6e-48c4-4fbd-b57e-abf8b58567e1 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-beccab6e-48c4-4fbd-b57e-abf8b58567e1 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-beccab6e-48c4-4fbd-b57e-abf8b58567e1 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-beccab6e-48c4-4fbd-b57e-abf8b58567e1 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:07 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-beccab6e-48c4-4fbd-b57e-abf8b58567e1 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:13:07 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-beccab6e-48c4-4fbd-b57e-abf8b58567e1 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1720 microversion: 2.1 time: 0.192243 Apr 13 23:13:07 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 295/874] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:13:07 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1720 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:13:10 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5454d9c9-8d3f-42b7-b2f6-75caddff713f", "device": "/dev/vdb"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:13:10 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:13:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:10 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d0b702ab-bc03-49c0-9ae6-376e9276f717/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298534 Apr 13 23:13:10 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 290/875] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 23:13:09 2023] POST /compute/v2.1/servers/d0b702ab-bc03-49c0-9ae6-376e9276f717/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:13:34 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:13:34 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:13:34 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:13:34 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:13:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:34 user devstack@n-api.service[61612]: DEBUG nova.objects.instance [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lazy-loading 'services' on Instance uuid d0b702ab-bc03-49c0-9ae6-376e9276f717 {{(pid=61612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:13:34 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d0b702ab-bc03-49c0-9ae6-376e9276f717/os-volume_attachments/5454d9c9-8d3f-42b7-b2f6-75caddff713f" status: 202 len: 0 microversion: 2.1 time: 0.171923 Apr 13 23:13:34 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 291/876] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 23:13:34 2023] DELETE /compute/v2.1/servers/d0b702ab-bc03-49c0-9ae6-376e9276f717/os-volume_attachments/5454d9c9-8d3f-42b7-b2f6-75caddff713f => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:13:34 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:13:34 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:13:34 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:13:34 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:13:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:34 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:13:34 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d0b702ab-bc03-49c0-9ae6-376e9276f717" status: 204 len: 0 microversion: 2.1 time: 0.132786 Apr 13 23:13:34 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 296/877] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:13:34 2023] DELETE /compute/v2.1/servers/d0b702ab-bc03-49c0-9ae6-376e9276f717 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:13:34 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:13:34 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:13:34 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d24a8fd6-56c3-49c8-b653-8a7e76eba2a5 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:13:34 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-d24a8fd6-56c3-49c8-b653-8a7e76eba2a5 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:13:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d24a8fd6-56c3-49c8-b653-8a7e76eba2a5 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d24a8fd6-56c3-49c8-b653-8a7e76eba2a5 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d24a8fd6-56c3-49c8-b653-8a7e76eba2a5 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d24a8fd6-56c3-49c8-b653-8a7e76eba2a5 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d24a8fd6-56c3-49c8-b653-8a7e76eba2a5 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d24a8fd6-56c3-49c8-b653-8a7e76eba2a5 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:35 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-d24a8fd6-56c3-49c8-b653-8a7e76eba2a5 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1420e7febd479e8f23ad9784950f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cebfec442634e41b173904833269463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:13:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-d24a8fd6-56c3-49c8-b653-8a7e76eba2a5 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0b702ab-bc03-49c0-9ae6-376e9276f717" status: 200 len: 1548 microversion: 2.1 time: 0.470924 Apr 13 23:13:35 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 291/878] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:13:34 2023] GET /compute/v2.1/servers/d0b702ab-bc03-49c0-9ae6-376e9276f717 => generated 1548 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:13:35 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:13:35 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:13:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:35 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Going to try to terminate instance {{(pid=61612) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:13:35 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962" status: 204 len: 0 microversion: 2.87 time: 0.245027 Apr 13 23:13:35 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 292/879] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 23:13:35 2023] DELETE /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 23:13:35 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-b53dee52-1114-4418-9636-877ebd50c9d8 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:13:35 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-b53dee52-1114-4418-9636-877ebd50c9d8 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:13:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b53dee52-1114-4418-9636-877ebd50c9d8 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b53dee52-1114-4418-9636-877ebd50c9d8 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b53dee52-1114-4418-9636-877ebd50c9d8 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b53dee52-1114-4418-9636-877ebd50c9d8 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b53dee52-1114-4418-9636-877ebd50c9d8 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b53dee52-1114-4418-9636-877ebd50c9d8 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:35 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-b53dee52-1114-4418-9636-877ebd50c9d8 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:13:35 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-b53dee52-1114-4418-9636-877ebd50c9d8 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:13:35 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-b53dee52-1114-4418-9636-877ebd50c9d8 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:13:35 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-b53dee52-1114-4418-9636-877ebd50c9d8 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962" status: 200 len: 1774 microversion: 2.87 time: 0.262094 Apr 13 23:13:35 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 297/880] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:13:35 2023] GET /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962 => generated 1774 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:13:35 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-92570266-4d65-4f2a-a20b-7913e873a430 req-5dbd6a09-80ab-48c9-a057-f71fea8073be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e9744c-04d3-486e-b032-90c672927962", "name": "network-vif-unplugged", "status": "completed", "tag": "7ae6b103-e1c6-42e6-9fcd-e76353955a76"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:13:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-92570266-4d65-4f2a-a20b-7913e873a430 req-5dbd6a09-80ab-48c9-a057-f71fea8073be service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-92570266-4d65-4f2a-a20b-7913e873a430 req-5dbd6a09-80ab-48c9-a057-f71fea8073be service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-92570266-4d65-4f2a-a20b-7913e873a430 req-5dbd6a09-80ab-48c9-a057-f71fea8073be service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-92570266-4d65-4f2a-a20b-7913e873a430 req-5dbd6a09-80ab-48c9-a057-f71fea8073be service nova] Creating event network-vif-unplugged:7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance a9e9744c-04d3-486e-b032-90c672927962 on user Apr 13 23:13:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-92570266-4d65-4f2a-a20b-7913e873a430 req-5dbd6a09-80ab-48c9-a057-f71fea8073be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044402 Apr 13 23:13:35 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 292/881] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:13:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:13:37 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-e0ee1674-a07c-4319-8674-009e30ad0bb3 req-c9f139ac-da6b-4148-a482-f900c410d19a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e9744c-04d3-486e-b032-90c672927962", "name": "network-vif-deleted", "tag": "7ae6b103-e1c6-42e6-9fcd-e76353955a76"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:13:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e0ee1674-a07c-4319-8674-009e30ad0bb3 req-c9f139ac-da6b-4148-a482-f900c410d19a service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e0ee1674-a07c-4319-8674-009e30ad0bb3 req-c9f139ac-da6b-4148-a482-f900c410d19a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:37 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e0ee1674-a07c-4319-8674-009e30ad0bb3 req-c9f139ac-da6b-4148-a482-f900c410d19a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:37 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-e0ee1674-a07c-4319-8674-009e30ad0bb3 req-c9f139ac-da6b-4148-a482-f900c410d19a service nova] Creating event network-vif-deleted:7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance a9e9744c-04d3-486e-b032-90c672927962 on user Apr 13 23:13:37 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-e0ee1674-a07c-4319-8674-009e30ad0bb3 req-c9f139ac-da6b-4148-a482-f900c410d19a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095006 Apr 13 23:13:37 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 293/882] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:13:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:13:37 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e9744c-04d3-486e-b032-90c672927962", "name": "network-vif-plugged", "status": "completed", "tag": "7ae6b103-e1c6-42e6-9fcd-e76353955a76"}, {"server_uuid": "d0b702ab-bc03-49c0-9ae6-376e9276f717", "name": "network-vif-unplugged", "status": "completed", "tag": "ce4496b6-af8d-489a-86cb-963886c9d30c"}, {"server_uuid": "d0b702ab-bc03-49c0-9ae6-376e9276f717", "name": "network-vif-plugged", "status": "completed", "tag": "ce4496b6-af8d-489a-86cb-963886c9d30c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:13:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:37 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] Creating event network-vif-plugged:7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance a9e9744c-04d3-486e-b032-90c672927962 on user Apr 13 23:13:37 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] Creating event network-vif-unplugged:ce4496b6-af8d-489a-86cb-963886c9d30c for instance d0b702ab-bc03-49c0-9ae6-376e9276f717 on user Apr 13 23:13:37 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] Creating event network-vif-plugged:ce4496b6-af8d-489a-86cb-963886c9d30c for instance d0b702ab-bc03-49c0-9ae6-376e9276f717 on user Apr 13 23:13:37 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.043252 Apr 13 23:13:37 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 298/883] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:13:37 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:13:39 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-858f9f12-f365-47dd-8388-db2618370adc req-38bea3de-0190-4c18-8a55-3fa519cb1c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b702ab-bc03-49c0-9ae6-376e9276f717", "name": "network-vif-deleted", "tag": "ce4496b6-af8d-489a-86cb-963886c9d30c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:13:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-858f9f12-f365-47dd-8388-db2618370adc req-38bea3de-0190-4c18-8a55-3fa519cb1c7f service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-858f9f12-f365-47dd-8388-db2618370adc req-38bea3de-0190-4c18-8a55-3fa519cb1c7f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:39 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-858f9f12-f365-47dd-8388-db2618370adc req-38bea3de-0190-4c18-8a55-3fa519cb1c7f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:39 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-858f9f12-f365-47dd-8388-db2618370adc req-38bea3de-0190-4c18-8a55-3fa519cb1c7f service nova] Creating event network-vif-deleted:ce4496b6-af8d-489a-86cb-963886c9d30c for instance d0b702ab-bc03-49c0-9ae6-376e9276f717 on user Apr 13 23:13:39 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-858f9f12-f365-47dd-8388-db2618370adc req-38bea3de-0190-4c18-8a55-3fa519cb1c7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035919 Apr 13 23:13:39 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 293/884] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:13:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:13:48 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:13:48 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:13:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-485528ca-d7a8-42dc-bb07-7a1a0c3004e3 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:13:48 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-485528ca-d7a8-42dc-bb07-7a1a0c3004e3 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:13:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-485528ca-d7a8-42dc-bb07-7a1a0c3004e3 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-485528ca-d7a8-42dc-bb07-7a1a0c3004e3 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-485528ca-d7a8-42dc-bb07-7a1a0c3004e3 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-485528ca-d7a8-42dc-bb07-7a1a0c3004e3 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-485528ca-d7a8-42dc-bb07-7a1a0c3004e3 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-485528ca-d7a8-42dc-bb07-7a1a0c3004e3 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-485528ca-d7a8-42dc-bb07-7a1a0c3004e3 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] HTTP exception thrown: Instance d6969342-d92d-4841-99a5-466d2eff89c2 could not be found. Apr 13 23:13:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-485528ca-d7a8-42dc-bb07-7a1a0c3004e3 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Request method failure captured: Apr 13 23:13:48 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/d6969342-d92d-4841-99a5-466d2eff89c2 HTTP/1.1 Apr 13 23:13:48 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:13:48 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:13:48 user devstack@n-api.service[61612]: Connection: close Apr 13 23:13:48 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:13:48 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:13:48 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:13:48 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:13:48 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:13:48 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOItlmM2WEyUn9lhtKjlxPi7Wqj5AxEXKiv4TeOeD7IeWKQbNz2gKoaX_XfEGNcSdyzWx21D8elVRAjhbWPZgXUjGS61Mzrez5Jy2NWKAFA7Bl9fO-maOGl0Fq9Atipe99en6g3b46BjKe3qKNUCpvCja9MC6xb3qQb5u5qw5b9YFQcw Apr 13 23:13:48 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:13:48 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:13:48 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:13:48 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:13:48 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:13:48 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:13:48 user devstack@n-api.service[61612]: X-Project-Id: c6455f36704e4b3088d8a9114b087fd3 Apr 13 23:13:48 user devstack@n-api.service[61612]: X-Project-Name: tempest-VolumesActionsTest-1756435814 Apr 13 23:13:48 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:13:48 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:13:48 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c6455f36704e4b3088d8a9114b087fd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c6455f36704e4b3088d8a9114b087fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c6455f36704e4b3088d8a9114b087fd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:13:48 user devstack@n-api.service[61612]: X-Tenant: tempest-VolumesActionsTest-1756435814 Apr 13 23:13:48 user devstack@n-api.service[61612]: X-Tenant-Id: c6455f36704e4b3088d8a9114b087fd3 Apr 13 23:13:48 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-VolumesActionsTest-1756435814 Apr 13 23:13:48 user devstack@n-api.service[61612]: X-User: tempest-VolumesActionsTest-1756435814-project-member Apr 13 23:13:48 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:13:48 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:13:48 user devstack@n-api.service[61612]: X-User-Id: 8c235879bc444a819061c4bb4bf3441b Apr 13 23:13:48 user devstack@n-api.service[61612]: X-User-Name: tempest-VolumesActionsTest-1756435814-project-member Apr 13 23:13:48 user devstack@n-api.service[61612]: method: > Apr 13 23:13:48 user devstack@n-api.service[61612]: exception: Instance d6969342-d92d-4841-99a5-466d2eff89c2 could not be found. Apr 13 23:13:48 user devstack@n-api.service[61612]: action_args: {'id': 'd6969342-d92d-4841-99a5-466d2eff89c2'} Apr 13 23:13:48 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6969342-d92d-4841-99a5-466d2eff89c2 could not be found. Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6969342-d92d-4841-99a5-466d2eff89c2 could not be found. Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6969342-d92d-4841-99a5-466d2eff89c2 could not be found. Apr 13 23:13:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:13:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-485528ca-d7a8-42dc-bb07-7a1a0c3004e3 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Returning 404 to user: Instance d6969342-d92d-4841-99a5-466d2eff89c2 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:13:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-485528ca-d7a8-42dc-bb07-7a1a0c3004e3 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6969342-d92d-4841-99a5-466d2eff89c2" status: 404 len: 111 microversion: 2.1 time: 0.188738 Apr 13 23:13:48 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 294/885] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:13:48 2023] GET /compute/v2.1/servers/d6969342-d92d-4841-99a5-466d2eff89c2 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:13:51 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:13:51 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:13:51 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-dac08bc2-fdbc-4cb8-bdb6-54069c6dc957 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:13:51 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-dac08bc2-fdbc-4cb8-bdb6-54069c6dc957 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:13:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-dac08bc2-fdbc-4cb8-bdb6-54069c6dc957 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-dac08bc2-fdbc-4cb8-bdb6-54069c6dc957 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-dac08bc2-fdbc-4cb8-bdb6-54069c6dc957 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-dac08bc2-fdbc-4cb8-bdb6-54069c6dc957 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-dac08bc2-fdbc-4cb8-bdb6-54069c6dc957 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-dac08bc2-fdbc-4cb8-bdb6-54069c6dc957 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:51 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-dac08bc2-fdbc-4cb8-bdb6-54069c6dc957 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.154051 Apr 13 23:13:51 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 299/886] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:13:51 2023] GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments => generated 25 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 23:13:55 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:13:55 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=10 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:13:55 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "878b14e5-70ba-4e27-8b5d-86fe258df2e9"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:13:55 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:13:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:13:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:13:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:13:55 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297032 Apr 13 23:13:55 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 294/887] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 23:13:55 2023] POST /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:14:03 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:14:03 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:14:03 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:03 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:04 user devstack@n-api.service[61612]: DEBUG nova.objects.instance [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lazy-loading 'services' on Instance uuid 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=61612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:14:04 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments/878b14e5-70ba-4e27-8b5d-86fe258df2e9" status: 202 len: 0 microversion: 2.1 time: 0.454843 Apr 13 23:14:04 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 295/888] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 23:14:03 2023] DELETE /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments/878b14e5-70ba-4e27-8b5d-86fe258df2e9 => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:14:04 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:04 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:04 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-c6a1dc9c-46bb-490f-b924-7a34bd132eea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:14:04 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-c6a1dc9c-46bb-490f-b924-7a34bd132eea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:14:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c6a1dc9c-46bb-490f-b924-7a34bd132eea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c6a1dc9c-46bb-490f-b924-7a34bd132eea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c6a1dc9c-46bb-490f-b924-7a34bd132eea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c6a1dc9c-46bb-490f-b924-7a34bd132eea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c6a1dc9c-46bb-490f-b924-7a34bd132eea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c6a1dc9c-46bb-490f-b924-7a34bd132eea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:04 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-c6a1dc9c-46bb-490f-b924-7a34bd132eea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059931 Apr 13 23:14:04 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 300/889] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:14:04 2023] GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:14:08 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:08 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:08 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:14:08 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:14:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:08 user devstack@n-api.service[61611]: DEBUG nova.objects.instance [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'services' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=61611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:14:08 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/os-volume_attachments/3e6ecd5a-e404-40a1-b361-bb3f3c3644ac" status: 202 len: 0 microversion: 2.1 time: 0.302573 Apr 13 23:14:08 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 295/890] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 23:14:08 2023] DELETE /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/os-volume_attachments/3e6ecd5a-e404-40a1-b361-bb3f3c3644ac => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:14:08 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-f5f59de3-5d1c-48be-afe5-2941748f8db8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:14:08 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-f5f59de3-5d1c-48be-afe5-2941748f8db8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:14:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f5f59de3-5d1c-48be-afe5-2941748f8db8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f5f59de3-5d1c-48be-afe5-2941748f8db8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f5f59de3-5d1c-48be-afe5-2941748f8db8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f5f59de3-5d1c-48be-afe5-2941748f8db8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f5f59de3-5d1c-48be-afe5-2941748f8db8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f5f59de3-5d1c-48be-afe5-2941748f8db8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:08 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-f5f59de3-5d1c-48be-afe5-2941748f8db8 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045041 Apr 13 23:14:08 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 296/891] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:14:08 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:14:25 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5242c1eb-7e64-4c9e-a679-7d50d2060f53 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:14:25 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-5242c1eb-7e64-4c9e-a679-7d50d2060f53 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:14:25 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:25 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5242c1eb-7e64-4c9e-a679-7d50d2060f53 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5242c1eb-7e64-4c9e-a679-7d50d2060f53 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5242c1eb-7e64-4c9e-a679-7d50d2060f53 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5242c1eb-7e64-4c9e-a679-7d50d2060f53 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5242c1eb-7e64-4c9e-a679-7d50d2060f53 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5242c1eb-7e64-4c9e-a679-7d50d2060f53 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:25 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-5242c1eb-7e64-4c9e-a679-7d50d2060f53 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] HTTP exception thrown: Instance d0b702ab-bc03-49c0-9ae6-376e9276f717 could not be found. Apr 13 23:14:25 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5242c1eb-7e64-4c9e-a679-7d50d2060f53 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Request method failure captured: Apr 13 23:14:25 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/d0b702ab-bc03-49c0-9ae6-376e9276f717 HTTP/1.1 Apr 13 23:14:25 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:14:25 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:14:25 user devstack@n-api.service[61613]: Connection: close Apr 13 23:14:25 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:14:25 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:14:25 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:14:25 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:14:25 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:14:25 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIwQr2-3QzekRfWdkf-YWXAh0-1VJpLk5IdQPw9Ma1Sm0pk2a1vb9FBFAAYUbAgyRrcD3g8QDdehhZnHB2gqI_hO2qSnczuY0KYKbE41ydvTEHfI8SyZ5VmSfCNFyH3MWOQcHCvXVWGRuSdYluUs8zwX946xG_yfBKxBHNxNQPvUTCk Apr 13 23:14:25 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:14:25 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:14:25 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:14:25 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:14:25 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:14:25 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:14:25 user devstack@n-api.service[61613]: X-Project-Id: 5cebfec442634e41b173904833269463 Apr 13 23:14:25 user devstack@n-api.service[61613]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1344748200 Apr 13 23:14:25 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:14:25 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:14:25 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5cebfec442634e41b173904833269463"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5cebfec442634e41b173904833269463"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5cebfec442634e41b173904833269463"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:14:25 user devstack@n-api.service[61613]: X-Tenant: tempest-VolumesSnapshotTestJSON-1344748200 Apr 13 23:14:25 user devstack@n-api.service[61613]: X-Tenant-Id: 5cebfec442634e41b173904833269463 Apr 13 23:14:25 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1344748200 Apr 13 23:14:25 user devstack@n-api.service[61613]: X-User: tempest-VolumesSnapshotTestJSON-1344748200-project-member Apr 13 23:14:25 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:14:25 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:14:25 user devstack@n-api.service[61613]: X-User-Id: 5a1420e7febd479e8f23ad9784950f65 Apr 13 23:14:25 user devstack@n-api.service[61613]: X-User-Name: tempest-VolumesSnapshotTestJSON-1344748200-project-member Apr 13 23:14:25 user devstack@n-api.service[61613]: method: > Apr 13 23:14:25 user devstack@n-api.service[61613]: exception: Instance d0b702ab-bc03-49c0-9ae6-376e9276f717 could not be found. Apr 13 23:14:25 user devstack@n-api.service[61613]: action_args: {'id': 'd0b702ab-bc03-49c0-9ae6-376e9276f717'} Apr 13 23:14:25 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b702ab-bc03-49c0-9ae6-376e9276f717 could not be found. Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b702ab-bc03-49c0-9ae6-376e9276f717 could not be found. Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b702ab-bc03-49c0-9ae6-376e9276f717 could not be found. Apr 13 23:14:25 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:14:25 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5242c1eb-7e64-4c9e-a679-7d50d2060f53 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Returning 404 to user: Instance d0b702ab-bc03-49c0-9ae6-376e9276f717 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:14:25 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-5242c1eb-7e64-4c9e-a679-7d50d2060f53 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0b702ab-bc03-49c0-9ae6-376e9276f717" status: 404 len: 111 microversion: 2.1 time: 0.038300 Apr 13 23:14:25 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 301/892] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:14:25 2023] GET /compute/v2.1/servers/d0b702ab-bc03-49c0-9ae6-376e9276f717 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:14:25 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:25 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:26 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-95d38f65-eb73-4d6d-b523-b128b1441958 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:14:26 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-95d38f65-eb73-4d6d-b523-b128b1441958 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:14:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-95d38f65-eb73-4d6d-b523-b128b1441958 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-95d38f65-eb73-4d6d-b523-b128b1441958 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-95d38f65-eb73-4d6d-b523-b128b1441958 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-95d38f65-eb73-4d6d-b523-b128b1441958 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-95d38f65-eb73-4d6d-b523-b128b1441958 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-95d38f65-eb73-4d6d-b523-b128b1441958 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-95d38f65-eb73-4d6d-b523-b128b1441958 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] HTTP exception thrown: Instance a9e9744c-04d3-486e-b032-90c672927962 could not be found. Apr 13 23:14:26 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-95d38f65-eb73-4d6d-b523-b128b1441958 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Request method failure captured: Apr 13 23:14:26 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962 HTTP/1.1 Apr 13 23:14:26 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:14:26 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:14:26 user devstack@n-api.service[61611]: Connection: close Apr 13 23:14:26 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:14:26 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:14:26 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:14:26 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:14:26 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:14:26 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIifwYhN3QvK0EhykzFHzX6u9gISN6-H09EezHTqcbEyy0QE9XgDwvm06RN3jmkmIYNViVv-Z-47XPn4j5od4Ulq6w1Gj__pMgqiEa-FbJIO-yHvFAv4BXbrWs5AMcyEj8N5T9u07OTbOTixM9hDbgogXfMepIRGgoGOFQOCLjS9ifs Apr 13 23:14:26 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:14:26 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:14:26 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:14:26 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:14:26 user devstack@n-api.service[61611]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 23:14:26 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:14:26 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:14:26 user devstack@n-api.service[61611]: X-Project-Id: 3fe77a2c491c4596ba7e6af3236d7de8 Apr 13 23:14:26 user devstack@n-api.service[61611]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1416841836 Apr 13 23:14:26 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:14:26 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:14:26 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3fe77a2c491c4596ba7e6af3236d7de8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3fe77a2c491c4596ba7e6af3236d7de8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3fe77a2c491c4596ba7e6af3236d7de8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:14:26 user devstack@n-api.service[61611]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1416841836 Apr 13 23:14:26 user devstack@n-api.service[61611]: X-Tenant-Id: 3fe77a2c491c4596ba7e6af3236d7de8 Apr 13 23:14:26 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1416841836 Apr 13 23:14:26 user devstack@n-api.service[61611]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member Apr 13 23:14:26 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:14:26 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:14:26 user devstack@n-api.service[61611]: X-User-Id: 6db44e7cb89a46c2999916b0a266b159 Apr 13 23:14:26 user devstack@n-api.service[61611]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member Apr 13 23:14:26 user devstack@n-api.service[61611]: method: > Apr 13 23:14:26 user devstack@n-api.service[61611]: exception: Instance a9e9744c-04d3-486e-b032-90c672927962 could not be found. Apr 13 23:14:26 user devstack@n-api.service[61611]: action_args: {'id': 'a9e9744c-04d3-486e-b032-90c672927962'} Apr 13 23:14:26 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9e9744c-04d3-486e-b032-90c672927962 could not be found. Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9e9744c-04d3-486e-b032-90c672927962 could not be found. Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9e9744c-04d3-486e-b032-90c672927962 could not be found. Apr 13 23:14:26 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:14:26 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-95d38f65-eb73-4d6d-b523-b128b1441958 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Returning 404 to user: Instance a9e9744c-04d3-486e-b032-90c672927962 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:14:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-95d38f65-eb73-4d6d-b523-b128b1441958 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962" status: 404 len: 111 microversion: 2.87 time: 0.034978 Apr 13 23:14:26 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 296/893] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:14:25 2023] GET /compute/v2.1/servers/a9e9744c-04d3-486e-b032-90c672927962 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:14:26 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:14:26 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:14:26 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:26 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:26 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Going to try to terminate instance {{(pid=61612) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:14:26 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" status: 204 len: 0 microversion: 2.87 time: 0.115898 Apr 13 23:14:26 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 297/894] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 23:14:26 2023] DELETE /compute/v2.1/servers/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 23:14:26 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-84bd9472-5ce3-4c0e-ad40-f642080a5ec0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:14:26 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-84bd9472-5ce3-4c0e-ad40-f642080a5ec0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:14:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-84bd9472-5ce3-4c0e-ad40-f642080a5ec0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-84bd9472-5ce3-4c0e-ad40-f642080a5ec0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-84bd9472-5ce3-4c0e-ad40-f642080a5ec0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-84bd9472-5ce3-4c0e-ad40-f642080a5ec0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-84bd9472-5ce3-4c0e-ad40-f642080a5ec0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-84bd9472-5ce3-4c0e-ad40-f642080a5ec0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:26 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-84bd9472-5ce3-4c0e-ad40-f642080a5ec0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:14:26 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-84bd9472-5ce3-4c0e-ad40-f642080a5ec0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:14:26 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-84bd9472-5ce3-4c0e-ad40-f642080a5ec0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:14:26 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-84bd9472-5ce3-4c0e-ad40-f642080a5ec0 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" status: 200 len: 1696 microversion: 2.87 time: 0.237274 Apr 13 23:14:26 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 302/895] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:14:26 2023] GET /compute/v2.1/servers/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 => generated 1696 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:14:26 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-6f024a7d-fb51-4d92-884f-e4f7997e1b91 req-d80408c5-fff2-4aad-8108-c52d7f64c4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57", "name": "network-vif-unplugged", "status": "completed", "tag": "d8177896-73ec-435e-8d3d-b468a1bf47a4"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:14:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-6f024a7d-fb51-4d92-884f-e4f7997e1b91 req-d80408c5-fff2-4aad-8108-c52d7f64c4a2 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-6f024a7d-fb51-4d92-884f-e4f7997e1b91 req-d80408c5-fff2-4aad-8108-c52d7f64c4a2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-6f024a7d-fb51-4d92-884f-e4f7997e1b91 req-d80408c5-fff2-4aad-8108-c52d7f64c4a2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-6f024a7d-fb51-4d92-884f-e4f7997e1b91 req-d80408c5-fff2-4aad-8108-c52d7f64c4a2 service nova] Creating event network-vif-unplugged:d8177896-73ec-435e-8d3d-b468a1bf47a4 for instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 on user Apr 13 23:14:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-6f024a7d-fb51-4d92-884f-e4f7997e1b91 req-d80408c5-fff2-4aad-8108-c52d7f64c4a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047747 Apr 13 23:14:26 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 297/896] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:14:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:14:28 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-1386ed73-ff6c-4dbf-b830-2c766eef9de3 req-a1112004-057d-484c-a6f6-b27b00330ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57", "name": "network-vif-plugged", "status": "completed", "tag": "d8177896-73ec-435e-8d3d-b468a1bf47a4"}, {"server_uuid": "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57", "name": "network-vif-deleted", "tag": "d8177896-73ec-435e-8d3d-b468a1bf47a4"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:14:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-1386ed73-ff6c-4dbf-b830-2c766eef9de3 req-a1112004-057d-484c-a6f6-b27b00330ca6 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-1386ed73-ff6c-4dbf-b830-2c766eef9de3 req-a1112004-057d-484c-a6f6-b27b00330ca6 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-1386ed73-ff6c-4dbf-b830-2c766eef9de3 req-a1112004-057d-484c-a6f6-b27b00330ca6 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:28 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-1386ed73-ff6c-4dbf-b830-2c766eef9de3 req-a1112004-057d-484c-a6f6-b27b00330ca6 service nova] Creating event network-vif-plugged:d8177896-73ec-435e-8d3d-b468a1bf47a4 for instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 on user Apr 13 23:14:28 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-1386ed73-ff6c-4dbf-b830-2c766eef9de3 req-a1112004-057d-484c-a6f6-b27b00330ca6 service nova] Creating event network-vif-deleted:d8177896-73ec-435e-8d3d-b468a1bf47a4 for instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 on user Apr 13 23:14:28 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-1386ed73-ff6c-4dbf-b830-2c766eef9de3 req-a1112004-057d-484c-a6f6-b27b00330ca6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030200 Apr 13 23:14:28 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 298/897] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:14:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:14:38 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1764780472", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "networks": [{"uuid": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe"}]}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:14:38 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=8 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:38 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:38 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] validate_networks() for [('005b22e6-73d8-42f9-bd5c-8d4aad956bfe', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:14:39 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:14:39 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:14:39 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:14:39 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:14:39 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:14:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:39 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Getting quotas for project 5cebfec442634e41b173904833269463. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:14:39 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Getting quotas for user 5a1420e7febd479e8f23ad9784950f65 and project 5cebfec442634e41b173904833269463. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:14:39 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:14:39 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:14:39 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.653841 Apr 13 23:14:39 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 303/898] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:14:38 2023] POST /compute/v2.1/servers => generated 378 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:14:39 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:39 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:39 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-35070932-7d57-4cea-b34a-ec1ea39c51a0 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:14:39 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-35070932-7d57-4cea-b34a-ec1ea39c51a0 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:14:39 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-35070932-7d57-4cea-b34a-ec1ea39c51a0 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1420e7febd479e8f23ad9784950f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cebfec442634e41b173904833269463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:14:39 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-35070932-7d57-4cea-b34a-ec1ea39c51a0 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08e157a4-85f9-466f-b02c-fd0fc629b302" status: 200 len: 1213 microversion: 2.1 time: 0.105513 Apr 13 23:14:39 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 298/899] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:14:39 2023] GET /compute/v2.1/servers/08e157a4-85f9-466f-b02c-fd0fc629b302 => generated 1213 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:14:42 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:42 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:42 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-7365b789-a55d-4318-86e1-4abd56b8d19e req-4a89de03-3ec3-4fb7-9284-5a0f25f7b971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e157a4-85f9-466f-b02c-fd0fc629b302", "tag": "5d213358-47f2-4420-be2b-8b4e69421009"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:14:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7365b789-a55d-4318-86e1-4abd56b8d19e req-4a89de03-3ec3-4fb7-9284-5a0f25f7b971 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7365b789-a55d-4318-86e1-4abd56b8d19e req-4a89de03-3ec3-4fb7-9284-5a0f25f7b971 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7365b789-a55d-4318-86e1-4abd56b8d19e req-4a89de03-3ec3-4fb7-9284-5a0f25f7b971 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:42 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-7365b789-a55d-4318-86e1-4abd56b8d19e req-4a89de03-3ec3-4fb7-9284-5a0f25f7b971 service nova] Creating event network-changed:5d213358-47f2-4420-be2b-8b4e69421009 for instance 08e157a4-85f9-466f-b02c-fd0fc629b302 on user Apr 13 23:14:42 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-7365b789-a55d-4318-86e1-4abd56b8d19e req-4a89de03-3ec3-4fb7-9284-5a0f25f7b971 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033682 Apr 13 23:14:42 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 299/900] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:14:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:14:44 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-3655a0c5-8016-4c12-937d-f8ecb0e9ab61 req-d071c588-7bf3-4d4c-a56c-e40a2d1d9155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e157a4-85f9-466f-b02c-fd0fc629b302", "name": "network-vif-plugged", "status": "completed", "tag": "5d213358-47f2-4420-be2b-8b4e69421009"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:14:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3655a0c5-8016-4c12-937d-f8ecb0e9ab61 req-d071c588-7bf3-4d4c-a56c-e40a2d1d9155 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3655a0c5-8016-4c12-937d-f8ecb0e9ab61 req-d071c588-7bf3-4d4c-a56c-e40a2d1d9155 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3655a0c5-8016-4c12-937d-f8ecb0e9ab61 req-d071c588-7bf3-4d4c-a56c-e40a2d1d9155 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:44 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-3655a0c5-8016-4c12-937d-f8ecb0e9ab61 req-d071c588-7bf3-4d4c-a56c-e40a2d1d9155 service nova] Creating event network-vif-plugged:5d213358-47f2-4420-be2b-8b4e69421009 for instance 08e157a4-85f9-466f-b02c-fd0fc629b302 on user Apr 13 23:14:44 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-3655a0c5-8016-4c12-937d-f8ecb0e9ab61 req-d071c588-7bf3-4d4c-a56c-e40a2d1d9155 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163800 Apr 13 23:14:44 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 304/901] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:14:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:14:46 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-63ce3a16-24f4-4d4e-9494-f62e14271303 req-0ee7df39-e68d-4c33-a851-6ba69fe2c4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e157a4-85f9-466f-b02c-fd0fc629b302", "name": "network-vif-plugged", "status": "completed", "tag": "5d213358-47f2-4420-be2b-8b4e69421009"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:14:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-63ce3a16-24f4-4d4e-9494-f62e14271303 req-0ee7df39-e68d-4c33-a851-6ba69fe2c4d2 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-63ce3a16-24f4-4d4e-9494-f62e14271303 req-0ee7df39-e68d-4c33-a851-6ba69fe2c4d2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-63ce3a16-24f4-4d4e-9494-f62e14271303 req-0ee7df39-e68d-4c33-a851-6ba69fe2c4d2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:46 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-63ce3a16-24f4-4d4e-9494-f62e14271303 req-0ee7df39-e68d-4c33-a851-6ba69fe2c4d2 service nova] Creating event network-vif-plugged:5d213358-47f2-4420-be2b-8b4e69421009 for instance 08e157a4-85f9-466f-b02c-fd0fc629b302 on user Apr 13 23:14:46 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-63ce3a16-24f4-4d4e-9494-f62e14271303 req-0ee7df39-e68d-4c33-a851-6ba69fe2c4d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030353 Apr 13 23:14:46 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 299/902] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:14:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:14:54 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:54 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:54 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-6de6f555-aa83-4d6f-b27a-534b7b48e4f3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:14:54 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-6de6f555-aa83-4d6f-b27a-534b7b48e4f3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:14:54 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6de6f555-aa83-4d6f-b27a-534b7b48e4f3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:54 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6de6f555-aa83-4d6f-b27a-534b7b48e4f3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:54 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6de6f555-aa83-4d6f-b27a-534b7b48e4f3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:54 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6de6f555-aa83-4d6f-b27a-534b7b48e4f3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:54 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6de6f555-aa83-4d6f-b27a-534b7b48e4f3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:54 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6de6f555-aa83-4d6f-b27a-534b7b48e4f3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:54 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-6de6f555-aa83-4d6f-b27a-534b7b48e4f3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046086 Apr 13 23:14:54 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 300/903] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:14:54 2023] GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 23:14:58 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:58 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:58 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:58 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:58 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72fc9050-a147-486d-87e7-d38a17c5bd4d"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:14:58 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:14:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:58 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345364 Apr 13 23:14:58 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 305/904] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 23:14:58 2023] POST /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:14:58 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-3150d37c-7b0f-4bb1-8162-b576324145f7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:14:58 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-3150d37c-7b0f-4bb1-8162-b576324145f7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:14:58 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:58 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:58 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:14:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3150d37c-7b0f-4bb1-8162-b576324145f7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3150d37c-7b0f-4bb1-8162-b576324145f7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3150d37c-7b0f-4bb1-8162-b576324145f7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3150d37c-7b0f-4bb1-8162-b576324145f7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3150d37c-7b0f-4bb1-8162-b576324145f7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3150d37c-7b0f-4bb1-8162-b576324145f7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-3150d37c-7b0f-4bb1-8162-b576324145f7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058457 Apr 13 23:14:58 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 300/905] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:14:58 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 13 23:14:58 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-3a903bd8-fbcb-45a3-9d99-0ed5414e08c9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:14:58 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-3a903bd8-fbcb-45a3-9d99-0ed5414e08c9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:14:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3a903bd8-fbcb-45a3-9d99-0ed5414e08c9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3a903bd8-fbcb-45a3-9d99-0ed5414e08c9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3a903bd8-fbcb-45a3-9d99-0ed5414e08c9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3a903bd8-fbcb-45a3-9d99-0ed5414e08c9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3a903bd8-fbcb-45a3-9d99-0ed5414e08c9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3a903bd8-fbcb-45a3-9d99-0ed5414e08c9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:58 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-3a903bd8-fbcb-45a3-9d99-0ed5414e08c9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:14:58 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-3a903bd8-fbcb-45a3-9d99-0ed5414e08c9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1674 microversion: 2.1 time: 0.188573 Apr 13 23:14:58 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 301/906] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:14:58 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1674 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:14:58 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-16706043-8217-4a1e-ae8c-9c4614dcb4a0 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:14:58 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-16706043-8217-4a1e-ae8c-9c4614dcb4a0 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:14:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-16706043-8217-4a1e-ae8c-9c4614dcb4a0 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-16706043-8217-4a1e-ae8c-9c4614dcb4a0 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-16706043-8217-4a1e-ae8c-9c4614dcb4a0 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-16706043-8217-4a1e-ae8c-9c4614dcb4a0 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-16706043-8217-4a1e-ae8c-9c4614dcb4a0 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-16706043-8217-4a1e-ae8c-9c4614dcb4a0 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:59 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-16706043-8217-4a1e-ae8c-9c4614dcb4a0 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:14:59 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-16706043-8217-4a1e-ae8c-9c4614dcb4a0 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1674 microversion: 2.1 time: 0.174049 Apr 13 23:14:59 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 306/907] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:14:58 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:14:59 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5b0f21b4-1a76-4ac2-b07a-4e0ac3c53110 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:14:59 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-5b0f21b4-1a76-4ac2-b07a-4e0ac3c53110 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:14:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5b0f21b4-1a76-4ac2-b07a-4e0ac3c53110 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5b0f21b4-1a76-4ac2-b07a-4e0ac3c53110 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5b0f21b4-1a76-4ac2-b07a-4e0ac3c53110 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5b0f21b4-1a76-4ac2-b07a-4e0ac3c53110 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:14:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5b0f21b4-1a76-4ac2-b07a-4e0ac3c53110 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:14:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5b0f21b4-1a76-4ac2-b07a-4e0ac3c53110 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:14:59 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-5b0f21b4-1a76-4ac2-b07a-4e0ac3c53110 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:14:59 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-5b0f21b4-1a76-4ac2-b07a-4e0ac3c53110 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1674 microversion: 2.1 time: 0.166617 Apr 13 23:14:59 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 301/908] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:14:59 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:15:06 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:15:06 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:15:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:06 user devstack@n-api.service[61612]: DEBUG nova.objects.instance [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lazy-loading 'services' on Instance uuid 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=61612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:15:06 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments/72fc9050-a147-486d-87e7-d38a17c5bd4d" status: 202 len: 0 microversion: 2.1 time: 0.179708 Apr 13 23:15:06 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 302/909] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 23:15:06 2023] DELETE /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments/72fc9050-a147-486d-87e7-d38a17c5bd4d => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:15:06 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-56be7886-ca35-4752-952f-229e1d907b8d tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:15:06 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-56be7886-ca35-4752-952f-229e1d907b8d tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:15:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-56be7886-ca35-4752-952f-229e1d907b8d tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-56be7886-ca35-4752-952f-229e1d907b8d tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-56be7886-ca35-4752-952f-229e1d907b8d tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-56be7886-ca35-4752-952f-229e1d907b8d tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-56be7886-ca35-4752-952f-229e1d907b8d tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-56be7886-ca35-4752-952f-229e1d907b8d tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-56be7886-ca35-4752-952f-229e1d907b8d tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058607 Apr 13 23:15:06 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 307/910] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:15:06 2023] GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:15:16 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-adf330f8-dc47-4f2b-ba96-20a190887402 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:15:16 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-adf330f8-dc47-4f2b-ba96-20a190887402 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:15:16 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:15:16 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=12 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:15:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-adf330f8-dc47-4f2b-ba96-20a190887402 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-adf330f8-dc47-4f2b-ba96-20a190887402 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-adf330f8-dc47-4f2b-ba96-20a190887402 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-adf330f8-dc47-4f2b-ba96-20a190887402 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-adf330f8-dc47-4f2b-ba96-20a190887402 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-adf330f8-dc47-4f2b-ba96-20a190887402 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:16 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-adf330f8-dc47-4f2b-ba96-20a190887402 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] HTTP exception thrown: Instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 could not be found. Apr 13 23:15:16 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-adf330f8-dc47-4f2b-ba96-20a190887402 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Request method failure captured: Apr 13 23:15:16 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 HTTP/1.1 Apr 13 23:15:16 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:15:16 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:15:16 user devstack@n-api.service[61611]: Connection: close Apr 13 23:15:16 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:15:16 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:15:16 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:15:16 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:15:16 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:15:16 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIifwYhN3QvK0EhykzFHzX6u9gISN6-H09EezHTqcbEyy0QE9XgDwvm06RN3jmkmIYNViVv-Z-47XPn4j5od4Ulq6w1Gj__pMgqiEa-FbJIO-yHvFAv4BXbrWs5AMcyEj8N5T9u07OTbOTixM9hDbgogXfMepIRGgoGOFQOCLjS9ifs Apr 13 23:15:16 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:15:16 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:15:16 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:15:16 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:15:16 user devstack@n-api.service[61611]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 23:15:16 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:15:16 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:15:16 user devstack@n-api.service[61611]: X-Project-Id: 3fe77a2c491c4596ba7e6af3236d7de8 Apr 13 23:15:16 user devstack@n-api.service[61611]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1416841836 Apr 13 23:15:16 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:15:16 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:15:16 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3fe77a2c491c4596ba7e6af3236d7de8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3fe77a2c491c4596ba7e6af3236d7de8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3fe77a2c491c4596ba7e6af3236d7de8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:15:16 user devstack@n-api.service[61611]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1416841836 Apr 13 23:15:16 user devstack@n-api.service[61611]: X-Tenant-Id: 3fe77a2c491c4596ba7e6af3236d7de8 Apr 13 23:15:16 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1416841836 Apr 13 23:15:16 user devstack@n-api.service[61611]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member Apr 13 23:15:16 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:15:16 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:15:16 user devstack@n-api.service[61611]: X-User-Id: 6db44e7cb89a46c2999916b0a266b159 Apr 13 23:15:16 user devstack@n-api.service[61611]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member Apr 13 23:15:16 user devstack@n-api.service[61611]: method: > Apr 13 23:15:16 user devstack@n-api.service[61611]: exception: Instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 could not be found. Apr 13 23:15:16 user devstack@n-api.service[61611]: action_args: {'id': '2d3ba9dd-fe6a-4d41-baab-9683ce65eb57'} Apr 13 23:15:16 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 could not be found. Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 could not be found. Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 could not be found. Apr 13 23:15:16 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:15:16 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-adf330f8-dc47-4f2b-ba96-20a190887402 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Returning 404 to user: Instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:15:16 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-adf330f8-dc47-4f2b-ba96-20a190887402 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" status: 404 len: 111 microversion: 2.87 time: 0.032109 Apr 13 23:15:16 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 302/911] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:15:16 2023] GET /compute/v2.1/servers/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:15:16 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:15:16 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:15:16 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:15:16 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:15:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:16 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Going to try to terminate instance {{(pid=61612) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:15:16 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8" status: 204 len: 0 microversion: 2.87 time: 0.175230 Apr 13 23:15:16 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 303/912] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 23:15:16 2023] DELETE /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 23:15:16 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:15:16 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:15:16 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-b085452a-e0de-4cdd-bbee-41182a2be5b9 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:15:16 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-b085452a-e0de-4cdd-bbee-41182a2be5b9 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:15:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b085452a-e0de-4cdd-bbee-41182a2be5b9 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b085452a-e0de-4cdd-bbee-41182a2be5b9 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b085452a-e0de-4cdd-bbee-41182a2be5b9 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b085452a-e0de-4cdd-bbee-41182a2be5b9 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b085452a-e0de-4cdd-bbee-41182a2be5b9 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b085452a-e0de-4cdd-bbee-41182a2be5b9 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:17 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-b085452a-e0de-4cdd-bbee-41182a2be5b9 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:15:17 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-b085452a-e0de-4cdd-bbee-41182a2be5b9 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:15:17 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-b085452a-e0de-4cdd-bbee-41182a2be5b9 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:15:17 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-b085452a-e0de-4cdd-bbee-41182a2be5b9 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8" status: 200 len: 1774 microversion: 2.87 time: 0.201051 Apr 13 23:15:17 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 308/913] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:15:16 2023] GET /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8 => generated 1774 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:15:17 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-9dd661dd-f999-49bd-8070-345c6767e88f req-b185ee41-2692-49b9-8f13-5f273e37234c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ec73b0-9b2a-4fc1-be85-4179075afdb8", "name": "network-vif-unplugged", "status": "completed", "tag": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:15:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9dd661dd-f999-49bd-8070-345c6767e88f req-b185ee41-2692-49b9-8f13-5f273e37234c service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9dd661dd-f999-49bd-8070-345c6767e88f req-b185ee41-2692-49b9-8f13-5f273e37234c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9dd661dd-f999-49bd-8070-345c6767e88f req-b185ee41-2692-49b9-8f13-5f273e37234c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:17 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-9dd661dd-f999-49bd-8070-345c6767e88f req-b185ee41-2692-49b9-8f13-5f273e37234c service nova] Creating event network-vif-unplugged:0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 on user Apr 13 23:15:17 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-9dd661dd-f999-49bd-8070-345c6767e88f req-b185ee41-2692-49b9-8f13-5f273e37234c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.187536 Apr 13 23:15:17 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 303/914] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:15:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:15:19 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-9d573510-5e0d-42e1-801c-f97c1682a597 req-8deeb360-ce2c-43c1-aeb5-7b3e9797b348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ec73b0-9b2a-4fc1-be85-4179075afdb8", "name": "network-vif-deleted", "tag": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:15:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-9d573510-5e0d-42e1-801c-f97c1682a597 req-8deeb360-ce2c-43c1-aeb5-7b3e9797b348 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-9d573510-5e0d-42e1-801c-f97c1682a597 req-8deeb360-ce2c-43c1-aeb5-7b3e9797b348 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-9d573510-5e0d-42e1-801c-f97c1682a597 req-8deeb360-ce2c-43c1-aeb5-7b3e9797b348 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:19 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-9d573510-5e0d-42e1-801c-f97c1682a597 req-8deeb360-ce2c-43c1-aeb5-7b3e9797b348 service nova] Creating event network-vif-deleted:0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 on user Apr 13 23:15:19 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-9d573510-5e0d-42e1-801c-f97c1682a597 req-8deeb360-ce2c-43c1-aeb5-7b3e9797b348 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035712 Apr 13 23:15:19 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 304/915] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:15:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:15:19 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-a0bdb0af-62c5-480a-a4cf-1090b8b74b03 req-57fa7b64-4d78-4a0a-92f4-55ea353f0dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ec73b0-9b2a-4fc1-be85-4179075afdb8", "name": "network-vif-plugged", "status": "completed", "tag": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:15:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a0bdb0af-62c5-480a-a4cf-1090b8b74b03 req-57fa7b64-4d78-4a0a-92f4-55ea353f0dcf service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a0bdb0af-62c5-480a-a4cf-1090b8b74b03 req-57fa7b64-4d78-4a0a-92f4-55ea353f0dcf service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a0bdb0af-62c5-480a-a4cf-1090b8b74b03 req-57fa7b64-4d78-4a0a-92f4-55ea353f0dcf service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:19 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-a0bdb0af-62c5-480a-a4cf-1090b8b74b03 req-57fa7b64-4d78-4a0a-92f4-55ea353f0dcf service nova] Creating event network-vif-plugged:0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 on user Apr 13 23:15:19 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-a0bdb0af-62c5-480a-a4cf-1090b8b74b03 req-57fa7b64-4d78-4a0a-92f4-55ea353f0dcf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031327 Apr 13 23:15:19 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 309/916] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:15:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:15:23 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-edfab6ed-b917-4d8d-a448-a436d2893fd4 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Action: 'create', calling method: .version_select at 0x7f3d1c3548b0>, body: {"keypair": {"name": "tempest-TestStampPattern-668013808", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxngmtHMJIADwXoPdcP64dxJrdZcaQq8ZVb5LBBk6F0TkqkReYSndg67icZJTwj7D2TIUZMiTemX6uBfFkKD0HqzbnjwwgnGTBQZoTeuc/1Bea3ZpvzfMXUi7CmzqHVvA=="}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:15:23 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-edfab6ed-b917-4d8d-a448-a436d2893fd4 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Getting quotas for project a71645bbbfcc4e41994fe910043ca0dd. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:15:23 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-edfab6ed-b917-4d8d-a448-a436d2893fd4 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Getting quotas for user 17551363dd9f4e219ad7198b21509e48 and project a71645bbbfcc4e41994fe910043ca0dd. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:15:23 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-edfab6ed-b917-4d8d-a448-a436d2893fd4 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.193539 Apr 13 23:15:23 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 304/917] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 23:15:23 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:15:26 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1291739265", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "key_name": "tempest-TestStampPattern-668013808", "security_groups": [{"name": "tempest-secgroup-smoke-477866808"}], "networks": [{"uuid": "077aa2c8-8cb6-4692-92ba-82064a0163d2"}]}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:15:26 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] validate_networks() for [('077aa2c8-8cb6-4692-92ba-82064a0163d2', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:15:26 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:15:26 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:15:26 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:15:26 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:15:26 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:15:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:26 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Getting quotas for project a71645bbbfcc4e41994fe910043ca0dd. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:15:26 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Getting quotas for user 17551363dd9f4e219ad7198b21509e48 and project a71645bbbfcc4e41994fe910043ca0dd. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:15:26 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:15:26 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:15:26 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.558469 Apr 13 23:15:26 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 305/918] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:15:26 2023] POST /compute/v2.1/servers => generated 403 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:15:27 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-2840e709-e367-49c9-824b-6c7575248fba tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:15:27 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-2840e709-e367-49c9-824b-6c7575248fba tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:15:27 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-2840e709-e367-49c9-824b-6c7575248fba tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17551363dd9f4e219ad7198b21509e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71645bbbfcc4e41994fe910043ca0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:15:27 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-2840e709-e367-49c9-824b-6c7575248fba tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26" status: 200 len: 1236 microversion: 2.1 time: 0.065614 Apr 13 23:15:27 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 310/919] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:15:27 2023] GET /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26 => generated 1236 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:15:29 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:15:29 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-db5abe01-4ba8-4013-884a-862769855c0b req-49b5c565-36c2-4680-a13a-4aefba21edff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f522c0be-7d51-421c-8d6c-d01ce6f6eb26", "tag": "319f1294-7d2b-4725-8ecd-a21ef3df06e8"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:15:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-db5abe01-4ba8-4013-884a-862769855c0b req-49b5c565-36c2-4680-a13a-4aefba21edff service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-db5abe01-4ba8-4013-884a-862769855c0b req-49b5c565-36c2-4680-a13a-4aefba21edff service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-db5abe01-4ba8-4013-884a-862769855c0b req-49b5c565-36c2-4680-a13a-4aefba21edff service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:29 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-db5abe01-4ba8-4013-884a-862769855c0b req-49b5c565-36c2-4680-a13a-4aefba21edff service nova] Creating event network-changed:319f1294-7d2b-4725-8ecd-a21ef3df06e8 for instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 on user Apr 13 23:15:29 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-db5abe01-4ba8-4013-884a-862769855c0b req-49b5c565-36c2-4680-a13a-4aefba21edff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030724 Apr 13 23:15:29 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 305/920] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:15:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:15:29 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-d2e1e943-4f53-43e4-bda8-3b017ae8655d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:15:29 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-d2e1e943-4f53-43e4-bda8-3b017ae8655d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:15:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d2e1e943-4f53-43e4-bda8-3b017ae8655d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d2e1e943-4f53-43e4-bda8-3b017ae8655d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d2e1e943-4f53-43e4-bda8-3b017ae8655d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d2e1e943-4f53-43e4-bda8-3b017ae8655d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d2e1e943-4f53-43e4-bda8-3b017ae8655d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d2e1e943-4f53-43e4-bda8-3b017ae8655d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:29 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-d2e1e943-4f53-43e4-bda8-3b017ae8655d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1420e7febd479e8f23ad9784950f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cebfec442634e41b173904833269463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:15:29 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-d2e1e943-4f53-43e4-bda8-3b017ae8655d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08e157a4-85f9-466f-b02c-fd0fc629b302" status: 200 len: 1496 microversion: 2.1 time: 0.144535 Apr 13 23:15:29 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 306/921] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:15:29 2023] GET /compute/v2.1/servers/08e157a4-85f9-466f-b02c-fd0fc629b302 => generated 1496 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:15:31 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=8 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:15:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-cd0002ab-c7ce-4ef5-a6ac-9f55541c9967 req-69e1cd34-42d8-446c-b9e2-6713acbdb3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f522c0be-7d51-421c-8d6c-d01ce6f6eb26", "name": "network-vif-plugged", "status": "completed", "tag": "319f1294-7d2b-4725-8ecd-a21ef3df06e8"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:15:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-cd0002ab-c7ce-4ef5-a6ac-9f55541c9967 req-69e1cd34-42d8-446c-b9e2-6713acbdb3c2 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-cd0002ab-c7ce-4ef5-a6ac-9f55541c9967 req-69e1cd34-42d8-446c-b9e2-6713acbdb3c2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-cd0002ab-c7ce-4ef5-a6ac-9f55541c9967 req-69e1cd34-42d8-446c-b9e2-6713acbdb3c2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:31 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-cd0002ab-c7ce-4ef5-a6ac-9f55541c9967 req-69e1cd34-42d8-446c-b9e2-6713acbdb3c2 service nova] Creating event network-vif-plugged:319f1294-7d2b-4725-8ecd-a21ef3df06e8 for instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 on user Apr 13 23:15:31 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-cd0002ab-c7ce-4ef5-a6ac-9f55541c9967 req-69e1cd34-42d8-446c-b9e2-6713acbdb3c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068556 Apr 13 23:15:31 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 311/922] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:15:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:15:33 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-9f86cd2c-48cd-47bb-bb32-03728abb4a25 req-b95a0445-269a-43e5-94da-5f3df9384da9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f522c0be-7d51-421c-8d6c-d01ce6f6eb26", "name": "network-vif-plugged", "status": "completed", "tag": "319f1294-7d2b-4725-8ecd-a21ef3df06e8"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:15:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9f86cd2c-48cd-47bb-bb32-03728abb4a25 req-b95a0445-269a-43e5-94da-5f3df9384da9 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9f86cd2c-48cd-47bb-bb32-03728abb4a25 req-b95a0445-269a-43e5-94da-5f3df9384da9 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9f86cd2c-48cd-47bb-bb32-03728abb4a25 req-b95a0445-269a-43e5-94da-5f3df9384da9 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:33 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-9f86cd2c-48cd-47bb-bb32-03728abb4a25 req-b95a0445-269a-43e5-94da-5f3df9384da9 service nova] Creating event network-vif-plugged:319f1294-7d2b-4725-8ecd-a21ef3df06e8 for instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 on user Apr 13 23:15:33 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-9f86cd2c-48cd-47bb-bb32-03728abb4a25 req-b95a0445-269a-43e5-94da-5f3df9384da9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044204 Apr 13 23:15:33 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 306/923] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:15:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:15:56 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:15:56 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:15:56 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:15:56 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:15:56 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-e5ed8927-659a-4142-af26-1727c4a10c5f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:15:56 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-e5ed8927-659a-4142-af26-1727c4a10c5f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:15:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e5ed8927-659a-4142-af26-1727c4a10c5f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e5ed8927-659a-4142-af26-1727c4a10c5f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e5ed8927-659a-4142-af26-1727c4a10c5f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e5ed8927-659a-4142-af26-1727c4a10c5f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:15:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e5ed8927-659a-4142-af26-1727c4a10c5f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:15:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e5ed8927-659a-4142-af26-1727c4a10c5f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:15:56 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-e5ed8927-659a-4142-af26-1727c4a10c5f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.165667 Apr 13 23:15:56 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 307/924] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:15:56 2023] GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments => generated 25 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 23:16:00 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9e6f0a5-ac9a-43c7-aebd-a4784595f319"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:16:00 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:16:00 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:16:00 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=12 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:16:00 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:16:00 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:00 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:00 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:00 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:00 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:00 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:00 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:16:00 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:16:00 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:16:00 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-493b2750-289b-4988-9387-31b32c1e4cfe tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:16:00 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-493b2750-289b-4988-9387-31b32c1e4cfe tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:16:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-493b2750-289b-4988-9387-31b32c1e4cfe tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-493b2750-289b-4988-9387-31b32c1e4cfe tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-493b2750-289b-4988-9387-31b32c1e4cfe tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-493b2750-289b-4988-9387-31b32c1e4cfe tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-493b2750-289b-4988-9387-31b32c1e4cfe tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-493b2750-289b-4988-9387-31b32c1e4cfe tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:00 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347135 Apr 13 23:16:00 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 312/925] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 23:16:00 2023] POST /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:16:00 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-493b2750-289b-4988-9387-31b32c1e4cfe tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:16:00 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-493b2750-289b-4988-9387-31b32c1e4cfe tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1674 microversion: 2.1 time: 0.178845 Apr 13 23:16:00 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 307/926] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:16:00 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1674 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:16:00 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef4e4a35-555c-4395-acaf-17e3d7446b18"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:16:00 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:16:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:00 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:01 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.344899 Apr 13 23:16:01 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 308/927] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 23:16:00 2023] POST /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:16:07 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-488cc72e-2ad7-4b32-8d82-5acd439c2963 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:16:07 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-488cc72e-2ad7-4b32-8d82-5acd439c2963 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:16:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-488cc72e-2ad7-4b32-8d82-5acd439c2963 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-488cc72e-2ad7-4b32-8d82-5acd439c2963 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-488cc72e-2ad7-4b32-8d82-5acd439c2963 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-488cc72e-2ad7-4b32-8d82-5acd439c2963 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-488cc72e-2ad7-4b32-8d82-5acd439c2963 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-488cc72e-2ad7-4b32-8d82-5acd439c2963 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:07 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-488cc72e-2ad7-4b32-8d82-5acd439c2963 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] HTTP exception thrown: Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 could not be found. Apr 13 23:16:07 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-488cc72e-2ad7-4b32-8d82-5acd439c2963 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Request method failure captured: Apr 13 23:16:07 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8 HTTP/1.1 Apr 13 23:16:07 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:16:07 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:16:07 user devstack@n-api.service[61613]: Connection: close Apr 13 23:16:07 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:16:07 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:16:07 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:16:07 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:16:07 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:16:07 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIifwYhN3QvK0EhykzFHzX6u9gISN6-H09EezHTqcbEyy0QE9XgDwvm06RN3jmkmIYNViVv-Z-47XPn4j5od4Ulq6w1Gj__pMgqiEa-FbJIO-yHvFAv4BXbrWs5AMcyEj8N5T9u07OTbOTixM9hDbgogXfMepIRGgoGOFQOCLjS9ifs Apr 13 23:16:07 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:16:07 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:16:07 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:16:07 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:16:07 user devstack@n-api.service[61613]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 23:16:07 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:16:07 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:16:07 user devstack@n-api.service[61613]: X-Project-Id: 3fe77a2c491c4596ba7e6af3236d7de8 Apr 13 23:16:07 user devstack@n-api.service[61613]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1416841836 Apr 13 23:16:07 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:16:07 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:16:07 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3fe77a2c491c4596ba7e6af3236d7de8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3fe77a2c491c4596ba7e6af3236d7de8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3fe77a2c491c4596ba7e6af3236d7de8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:16:07 user devstack@n-api.service[61613]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1416841836 Apr 13 23:16:07 user devstack@n-api.service[61613]: X-Tenant-Id: 3fe77a2c491c4596ba7e6af3236d7de8 Apr 13 23:16:07 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1416841836 Apr 13 23:16:07 user devstack@n-api.service[61613]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member Apr 13 23:16:07 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:16:07 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:16:07 user devstack@n-api.service[61613]: X-User-Id: 6db44e7cb89a46c2999916b0a266b159 Apr 13 23:16:07 user devstack@n-api.service[61613]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member Apr 13 23:16:07 user devstack@n-api.service[61613]: method: > Apr 13 23:16:07 user devstack@n-api.service[61613]: exception: Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 could not be found. Apr 13 23:16:07 user devstack@n-api.service[61613]: action_args: {'id': '31ec73b0-9b2a-4fc1-be85-4179075afdb8'} Apr 13 23:16:07 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 could not be found. Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 could not be found. Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 could not be found. Apr 13 23:16:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:16:07 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-488cc72e-2ad7-4b32-8d82-5acd439c2963 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Returning 404 to user: Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:16:07 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-488cc72e-2ad7-4b32-8d82-5acd439c2963 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8" status: 404 len: 111 microversion: 2.87 time: 0.044971 Apr 13 23:16:07 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 313/928] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:16:07 2023] GET /compute/v2.1/servers/31ec73b0-9b2a-4fc1-be85-4179075afdb8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:16:07 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:16:07 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:16:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:07 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:16:07 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7226cc11-4c2c-4a27-bb02-87ba1f749d33" status: 204 len: 0 microversion: 2.87 time: 0.119046 Apr 13 23:16:07 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 308/929] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 23:16:07 2023] DELETE /compute/v2.1/servers/7226cc11-4c2c-4a27-bb02-87ba1f749d33 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 23:16:07 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-ae7fa780-cbd3-4ec6-82a6-27fb87e7c522 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:16:07 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-ae7fa780-cbd3-4ec6-82a6-27fb87e7c522 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:16:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ae7fa780-cbd3-4ec6-82a6-27fb87e7c522 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ae7fa780-cbd3-4ec6-82a6-27fb87e7c522 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ae7fa780-cbd3-4ec6-82a6-27fb87e7c522 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ae7fa780-cbd3-4ec6-82a6-27fb87e7c522 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ae7fa780-cbd3-4ec6-82a6-27fb87e7c522 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ae7fa780-cbd3-4ec6-82a6-27fb87e7c522 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:07 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-ae7fa780-cbd3-4ec6-82a6-27fb87e7c522 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:16:07 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-ae7fa780-cbd3-4ec6-82a6-27fb87e7c522 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:16:07 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-ae7fa780-cbd3-4ec6-82a6-27fb87e7c522 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:16:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-ae7fa780-cbd3-4ec6-82a6-27fb87e7c522 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7226cc11-4c2c-4a27-bb02-87ba1f749d33" status: 200 len: 1697 microversion: 2.87 time: 0.299783 Apr 13 23:16:07 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 309/930] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:16:07 2023] GET /compute/v2.1/servers/7226cc11-4c2c-4a27-bb02-87ba1f749d33 => generated 1697 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 13 23:16:07 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-d5aee83e-c71a-4b3e-8a4b-097b372483fd req-d257e547-c4ca-471b-87d9-42d0c923e8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7226cc11-4c2c-4a27-bb02-87ba1f749d33", "name": "network-vif-unplugged", "status": "completed", "tag": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:16:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d5aee83e-c71a-4b3e-8a4b-097b372483fd req-d257e547-c4ca-471b-87d9-42d0c923e8af service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d5aee83e-c71a-4b3e-8a4b-097b372483fd req-d257e547-c4ca-471b-87d9-42d0c923e8af service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d5aee83e-c71a-4b3e-8a4b-097b372483fd req-d257e547-c4ca-471b-87d9-42d0c923e8af service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:07 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-d5aee83e-c71a-4b3e-8a4b-097b372483fd req-d257e547-c4ca-471b-87d9-42d0c923e8af service nova] Creating event network-vif-unplugged:eefcee78-4e09-44b9-ad0c-7b7ee693a6fb for instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 on user Apr 13 23:16:07 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-d5aee83e-c71a-4b3e-8a4b-097b372483fd req-d257e547-c4ca-471b-87d9-42d0c923e8af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059657 Apr 13 23:16:07 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 314/931] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:16:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:16:08 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:16:08 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:16:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:08 user devstack@n-api.service[61611]: DEBUG nova.objects.instance [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lazy-loading 'services' on Instance uuid 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=61611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:16:08 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:16:08 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:16:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:08 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments/a9e6f0a5-ac9a-43c7-aebd-a4784595f319" status: 202 len: 0 microversion: 2.1 time: 0.164441 Apr 13 23:16:08 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 309/932] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 23:16:08 2023] DELETE /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments/a9e6f0a5-ac9a-43c7-aebd-a4784595f319 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:16:08 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e8c67c85-2c5d-4b46-ab45-9393be2e8ae5 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:16:09 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-e8c67c85-2c5d-4b46-ab45-9393be2e8ae5 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:16:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e8c67c85-2c5d-4b46-ab45-9393be2e8ae5 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e8c67c85-2c5d-4b46-ab45-9393be2e8ae5 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e8c67c85-2c5d-4b46-ab45-9393be2e8ae5 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e8c67c85-2c5d-4b46-ab45-9393be2e8ae5 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e8c67c85-2c5d-4b46-ab45-9393be2e8ae5 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e8c67c85-2c5d-4b46-ab45-9393be2e8ae5 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:09 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-edbba771-4712-4397-ba1d-b06a1133d6b4 req-b674b1e0-6594-434d-a37b-3930fd954a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7226cc11-4c2c-4a27-bb02-87ba1f749d33", "name": "network-vif-deleted", "tag": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:16:09 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-e8c67c85-2c5d-4b46-ab45-9393be2e8ae5 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050874 Apr 13 23:16:09 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 315/933] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:16:08 2023] GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:16:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-edbba771-4712-4397-ba1d-b06a1133d6b4 req-b674b1e0-6594-434d-a37b-3930fd954a38 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-edbba771-4712-4397-ba1d-b06a1133d6b4 req-b674b1e0-6594-434d-a37b-3930fd954a38 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-edbba771-4712-4397-ba1d-b06a1133d6b4 req-b674b1e0-6594-434d-a37b-3930fd954a38 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:09 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:16:09 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Old instance type m1.nano, new instance type m1.micro {{(pid=61612) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 13 23:16:09 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-edbba771-4712-4397-ba1d-b06a1133d6b4 req-b674b1e0-6594-434d-a37b-3930fd954a38 service nova] Creating event network-vif-deleted:eefcee78-4e09-44b9-ad0c-7b7ee693a6fb for instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 on user Apr 13 23:16:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:09 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-edbba771-4712-4397-ba1d-b06a1133d6b4 req-b674b1e0-6594-434d-a37b-3930fd954a38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082383 Apr 13 23:16:09 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 310/934] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:16:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:16:09 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting quotas for project 68330047a5fd4e4397cf5edca18c5b51. Resources: {'ram', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:16:09 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting quotas for user 59b2c11a23384f678a086de89139497d and project 68330047a5fd4e4397cf5edca18c5b51. Resources: {'ram', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:16:09 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:16:09 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:16:09 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:16:09 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:16:09 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:16:09 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/action" status: 202 len: 0 microversion: 2.1 time: 0.307306 Apr 13 23:16:09 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 310/935] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 23:16:08 2023] POST /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:16:09 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-4a14b360-7263-4657-9afd-4b2076d8e251 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:16:09 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-4a14b360-7263-4657-9afd-4b2076d8e251 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:16:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4a14b360-7263-4657-9afd-4b2076d8e251 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4a14b360-7263-4657-9afd-4b2076d8e251 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4a14b360-7263-4657-9afd-4b2076d8e251 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4a14b360-7263-4657-9afd-4b2076d8e251 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4a14b360-7263-4657-9afd-4b2076d8e251 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4a14b360-7263-4657-9afd-4b2076d8e251 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:09 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-4a14b360-7263-4657-9afd-4b2076d8e251 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:16:09 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-4a14b360-7263-4657-9afd-4b2076d8e251 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1729 microversion: 2.1 time: 0.167899 Apr 13 23:16:09 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 316/936] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:16:09 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:16:09 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-d2259c85-8c19-4f95-a171-f4397e22feba req-2c45bcdd-e7db-49ed-a190-24a288db7071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7226cc11-4c2c-4a27-bb02-87ba1f749d33", "name": "network-vif-plugged", "status": "completed", "tag": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:16:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d2259c85-8c19-4f95-a171-f4397e22feba req-2c45bcdd-e7db-49ed-a190-24a288db7071 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d2259c85-8c19-4f95-a171-f4397e22feba req-2c45bcdd-e7db-49ed-a190-24a288db7071 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d2259c85-8c19-4f95-a171-f4397e22feba req-2c45bcdd-e7db-49ed-a190-24a288db7071 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:10 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-d2259c85-8c19-4f95-a171-f4397e22feba req-2c45bcdd-e7db-49ed-a190-24a288db7071 service nova] Creating event network-vif-plugged:eefcee78-4e09-44b9-ad0c-7b7ee693a6fb for instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 on user Apr 13 23:16:10 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-d2259c85-8c19-4f95-a171-f4397e22feba req-2c45bcdd-e7db-49ed-a190-24a288db7071 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049631 Apr 13 23:16:10 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 311/937] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:16:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:16:12 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-2fbc7153-44fd-4ef0-90f4-f7f814514b4a req-1f4ce3a6-5f7b-4b55-b073-12c3d6c14f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d", "name": "network-vif-unplugged", "status": "completed", "tag": "09cc0c17-bd49-4207-9de4-89178a1e681e"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:16:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-2fbc7153-44fd-4ef0-90f4-f7f814514b4a req-1f4ce3a6-5f7b-4b55-b073-12c3d6c14f49 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-2fbc7153-44fd-4ef0-90f4-f7f814514b4a req-1f4ce3a6-5f7b-4b55-b073-12c3d6c14f49 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-2fbc7153-44fd-4ef0-90f4-f7f814514b4a req-1f4ce3a6-5f7b-4b55-b073-12c3d6c14f49 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:12 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-2fbc7153-44fd-4ef0-90f4-f7f814514b4a req-1f4ce3a6-5f7b-4b55-b073-12c3d6c14f49 service nova] Creating event network-vif-unplugged:09cc0c17-bd49-4207-9de4-89178a1e681e for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d on user Apr 13 23:16:12 user devstack@n-api.service[61612]: DEBUG nova.compute.api [req-2fbc7153-44fd-4ef0-90f4-f7f814514b4a req-1f4ce3a6-5f7b-4b55-b073-12c3d6c14f49 service nova] Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 23:16:12 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-2fbc7153-44fd-4ef0-90f4-f7f814514b4a req-1f4ce3a6-5f7b-4b55-b073-12c3d6c14f49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066671 Apr 13 23:16:12 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 311/938] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:16:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:16:14 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-681d4392-aded-474a-bf45-685e984208c2 req-1e0ca2e2-eb88-4a2c-a6d7-93abf36280d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d", "name": "network-vif-plugged", "status": "completed", "tag": "09cc0c17-bd49-4207-9de4-89178a1e681e"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:16:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-681d4392-aded-474a-bf45-685e984208c2 req-1e0ca2e2-eb88-4a2c-a6d7-93abf36280d3 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-681d4392-aded-474a-bf45-685e984208c2 req-1e0ca2e2-eb88-4a2c-a6d7-93abf36280d3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-681d4392-aded-474a-bf45-685e984208c2 req-1e0ca2e2-eb88-4a2c-a6d7-93abf36280d3 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:14 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-681d4392-aded-474a-bf45-685e984208c2 req-1e0ca2e2-eb88-4a2c-a6d7-93abf36280d3 service nova] Creating event network-vif-plugged:09cc0c17-bd49-4207-9de4-89178a1e681e for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d on user Apr 13 23:16:14 user devstack@n-api.service[61613]: DEBUG nova.compute.api [req-681d4392-aded-474a-bf45-685e984208c2 req-1e0ca2e2-eb88-4a2c-a6d7-93abf36280d3 service nova] Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 23:16:14 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-681d4392-aded-474a-bf45-685e984208c2 req-1e0ca2e2-eb88-4a2c-a6d7-93abf36280d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046855 Apr 13 23:16:14 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 317/939] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:16:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:16:17 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-44ef7044-fa25-4711-ab87-060397f9c6ee tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:16:17 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-44ef7044-fa25-4711-ab87-060397f9c6ee tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:16:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-44ef7044-fa25-4711-ab87-060397f9c6ee tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-44ef7044-fa25-4711-ab87-060397f9c6ee tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-44ef7044-fa25-4711-ab87-060397f9c6ee tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-44ef7044-fa25-4711-ab87-060397f9c6ee tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-44ef7044-fa25-4711-ab87-060397f9c6ee tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-44ef7044-fa25-4711-ab87-060397f9c6ee tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:17 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-44ef7044-fa25-4711-ab87-060397f9c6ee tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17551363dd9f4e219ad7198b21509e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71645bbbfcc4e41994fe910043ca0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:16:17 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-44ef7044-fa25-4711-ab87-060397f9c6ee tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26" status: 200 len: 1537 microversion: 2.1 time: 0.152360 Apr 13 23:16:17 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 312/940] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:16:17 2023] GET /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26 => generated 1537 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:16:23 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:16:23 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=24 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:16:23 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:16:23 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-46717121-fd5d-4b05-af53-f9da8c4e5ac8 req-e4d05e8b-e55d-4923-a231-25ab2954b15d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d", "name": "network-vif-plugged", "status": "completed", "tag": "09cc0c17-bd49-4207-9de4-89178a1e681e"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:16:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-46717121-fd5d-4b05-af53-f9da8c4e5ac8 req-e4d05e8b-e55d-4923-a231-25ab2954b15d service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-46717121-fd5d-4b05-af53-f9da8c4e5ac8 req-e4d05e8b-e55d-4923-a231-25ab2954b15d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-46717121-fd5d-4b05-af53-f9da8c4e5ac8 req-e4d05e8b-e55d-4923-a231-25ab2954b15d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:23 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-46717121-fd5d-4b05-af53-f9da8c4e5ac8 req-e4d05e8b-e55d-4923-a231-25ab2954b15d service nova] Creating event network-vif-plugged:09cc0c17-bd49-4207-9de4-89178a1e681e for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d on user Apr 13 23:16:23 user devstack@n-api.service[61612]: DEBUG nova.compute.api [req-46717121-fd5d-4b05-af53-f9da8c4e5ac8 req-e4d05e8b-e55d-4923-a231-25ab2954b15d service nova] Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 23:16:23 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-46717121-fd5d-4b05-af53-f9da8c4e5ac8 req-e4d05e8b-e55d-4923-a231-25ab2954b15d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082532 Apr 13 23:16:23 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 312/941] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:16:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:16:25 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=12 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:16:25 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:16:25 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-64552b87-c8f5-453f-ac7c-36e851b74642 req-a0a9f58e-19a3-495a-99f8-ff37db447c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d", "name": "network-vif-plugged", "status": "completed", "tag": "09cc0c17-bd49-4207-9de4-89178a1e681e"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:16:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-64552b87-c8f5-453f-ac7c-36e851b74642 req-a0a9f58e-19a3-495a-99f8-ff37db447c8c service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-64552b87-c8f5-453f-ac7c-36e851b74642 req-a0a9f58e-19a3-495a-99f8-ff37db447c8c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-64552b87-c8f5-453f-ac7c-36e851b74642 req-a0a9f58e-19a3-495a-99f8-ff37db447c8c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:25 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-64552b87-c8f5-453f-ac7c-36e851b74642 req-a0a9f58e-19a3-495a-99f8-ff37db447c8c service nova] Creating event network-vif-plugged:09cc0c17-bd49-4207-9de4-89178a1e681e for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d on user Apr 13 23:16:25 user devstack@n-api.service[61613]: DEBUG nova.compute.api [req-64552b87-c8f5-453f-ac7c-36e851b74642 req-a0a9f58e-19a3-495a-99f8-ff37db447c8c service nova] Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 23:16:25 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-64552b87-c8f5-453f-ac7c-36e851b74642 req-a0a9f58e-19a3-495a-99f8-ff37db447c8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045532 Apr 13 23:16:25 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 318/942] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:16:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:16:29 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:16:29 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:16:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9758d34b-f5c6-4696-92ad-30da450361d3", "device": "/dev/vdb"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:16:30 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:16:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:30 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] 10.0.0.210 "POST /compute/v2.1/servers/08e157a4-85f9-466f-b02c-fd0fc629b302/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.481600 Apr 13 23:16:30 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 313/943] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 23:16:29 2023] POST /compute/v2.1/servers/08e157a4-85f9-466f-b02c-fd0fc629b302/os-volume_attachments => generated 194 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 23:16:50 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:16:50 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:16:50 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:16:50 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:16:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:51 user devstack@n-api.service[61612]: DEBUG nova.objects.instance [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lazy-loading 'services' on Instance uuid 08e157a4-85f9-466f-b02c-fd0fc629b302 {{(pid=61612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:16:51 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/08e157a4-85f9-466f-b02c-fd0fc629b302/os-volume_attachments/9758d34b-f5c6-4696-92ad-30da450361d3" status: 202 len: 0 microversion: 2.1 time: 0.453441 Apr 13 23:16:51 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 313/944] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 23:16:50 2023] DELETE /compute/v2.1/servers/08e157a4-85f9-466f-b02c-fd0fc629b302/os-volume_attachments/9758d34b-f5c6-4696-92ad-30da450361d3 => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:16:51 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:16:51 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:16:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:51 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:16:51 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/08e157a4-85f9-466f-b02c-fd0fc629b302" status: 204 len: 0 microversion: 2.1 time: 0.142409 Apr 13 23:16:51 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 319/945] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:16:51 2023] DELETE /compute/v2.1/servers/08e157a4-85f9-466f-b02c-fd0fc629b302 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:16:51 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f5fb47d4-2e17-4906-b275-d86feb1312c5 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:16:51 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f5fb47d4-2e17-4906-b275-d86feb1312c5 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:16:51 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:16:51 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:16:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f5fb47d4-2e17-4906-b275-d86feb1312c5 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f5fb47d4-2e17-4906-b275-d86feb1312c5 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f5fb47d4-2e17-4906-b275-d86feb1312c5 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f5fb47d4-2e17-4906-b275-d86feb1312c5 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f5fb47d4-2e17-4906-b275-d86feb1312c5 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f5fb47d4-2e17-4906-b275-d86feb1312c5 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:51 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-f5fb47d4-2e17-4906-b275-d86feb1312c5 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1420e7febd479e8f23ad9784950f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cebfec442634e41b173904833269463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:16:51 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f5fb47d4-2e17-4906-b275-d86feb1312c5 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08e157a4-85f9-466f-b02c-fd0fc629b302" status: 200 len: 1548 microversion: 2.1 time: 0.434053 Apr 13 23:16:51 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 314/946] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:16:51 2023] GET /compute/v2.1/servers/08e157a4-85f9-466f-b02c-fd0fc629b302 => generated 1548 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:16:53 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-d683f0e9-1848-4dc5-9ba6-f36c3a845b38 req-a7703e28-eed5-4776-a93a-c11901272b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e157a4-85f9-466f-b02c-fd0fc629b302", "name": "network-vif-unplugged", "status": "completed", "tag": "5d213358-47f2-4420-be2b-8b4e69421009"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:16:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d683f0e9-1848-4dc5-9ba6-f36c3a845b38 req-a7703e28-eed5-4776-a93a-c11901272b89 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d683f0e9-1848-4dc5-9ba6-f36c3a845b38 req-a7703e28-eed5-4776-a93a-c11901272b89 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d683f0e9-1848-4dc5-9ba6-f36c3a845b38 req-a7703e28-eed5-4776-a93a-c11901272b89 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:53 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-d683f0e9-1848-4dc5-9ba6-f36c3a845b38 req-a7703e28-eed5-4776-a93a-c11901272b89 service nova] Creating event network-vif-unplugged:5d213358-47f2-4420-be2b-8b4e69421009 for instance 08e157a4-85f9-466f-b02c-fd0fc629b302 on user Apr 13 23:16:53 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-d683f0e9-1848-4dc5-9ba6-f36c3a845b38 req-a7703e28-eed5-4776-a93a-c11901272b89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029697 Apr 13 23:16:53 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 314/947] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:16:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:16:54 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-f9d23eb8-16b4-4915-9c53-2053cc27ede7 req-fe3f30ed-8042-4809-9768-68827d3772fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e157a4-85f9-466f-b02c-fd0fc629b302", "name": "network-vif-deleted", "tag": "5d213358-47f2-4420-be2b-8b4e69421009"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:16:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-f9d23eb8-16b4-4915-9c53-2053cc27ede7 req-fe3f30ed-8042-4809-9768-68827d3772fe service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-f9d23eb8-16b4-4915-9c53-2053cc27ede7 req-fe3f30ed-8042-4809-9768-68827d3772fe service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-f9d23eb8-16b4-4915-9c53-2053cc27ede7 req-fe3f30ed-8042-4809-9768-68827d3772fe service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:54 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-f9d23eb8-16b4-4915-9c53-2053cc27ede7 req-fe3f30ed-8042-4809-9768-68827d3772fe service nova] Creating event network-vif-deleted:5d213358-47f2-4420-be2b-8b4e69421009 for instance 08e157a4-85f9-466f-b02c-fd0fc629b302 on user Apr 13 23:16:54 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-f9d23eb8-16b4-4915-9c53-2053cc27ede7 req-fe3f30ed-8042-4809-9768-68827d3772fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036309 Apr 13 23:16:54 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 320/948] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:16:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:16:55 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e157a4-85f9-466f-b02c-fd0fc629b302", "name": "network-vif-plugged", "status": "completed", "tag": "5d213358-47f2-4420-be2b-8b4e69421009"}, {"server_uuid": "08e157a4-85f9-466f-b02c-fd0fc629b302", "name": "network-vif-plugged", "status": "completed", "tag": "5d213358-47f2-4420-be2b-8b4e69421009"}, {"server_uuid": "08e157a4-85f9-466f-b02c-fd0fc629b302", "name": "network-vif-plugged", "status": "completed", "tag": "5d213358-47f2-4420-be2b-8b4e69421009"}, {"server_uuid": "08e157a4-85f9-466f-b02c-fd0fc629b302", "name": "network-vif-unplugged", "status": "completed", "tag": "5d213358-47f2-4420-be2b-8b4e69421009"}, {"server_uuid": "08e157a4-85f9-466f-b02c-fd0fc629b302", "name": "network-vif-plugged", "status": "completed", "tag": "5d213358-47f2-4420-be2b-8b4e69421009"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:16:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:55 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Creating event network-vif-plugged:5d213358-47f2-4420-be2b-8b4e69421009 for instance 08e157a4-85f9-466f-b02c-fd0fc629b302 on user Apr 13 23:16:55 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Creating event network-vif-plugged:5d213358-47f2-4420-be2b-8b4e69421009 for instance 08e157a4-85f9-466f-b02c-fd0fc629b302 on user Apr 13 23:16:55 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Creating event network-vif-plugged:5d213358-47f2-4420-be2b-8b4e69421009 for instance 08e157a4-85f9-466f-b02c-fd0fc629b302 on user Apr 13 23:16:55 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Creating event network-vif-unplugged:5d213358-47f2-4420-be2b-8b4e69421009 for instance 08e157a4-85f9-466f-b02c-fd0fc629b302 on user Apr 13 23:16:55 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Creating event network-vif-plugged:5d213358-47f2-4420-be2b-8b4e69421009 for instance 08e157a4-85f9-466f-b02c-fd0fc629b302 on user Apr 13 23:16:55 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.030555 Apr 13 23:16:55 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 315/949] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:16:55 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:16:57 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-0a76bc9a-fe1d-4a6b-aa6d-e147f8c1cbf1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:16:57 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-0a76bc9a-fe1d-4a6b-aa6d-e147f8c1cbf1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:16:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0a76bc9a-fe1d-4a6b-aa6d-e147f8c1cbf1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0a76bc9a-fe1d-4a6b-aa6d-e147f8c1cbf1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0a76bc9a-fe1d-4a6b-aa6d-e147f8c1cbf1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0a76bc9a-fe1d-4a6b-aa6d-e147f8c1cbf1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0a76bc9a-fe1d-4a6b-aa6d-e147f8c1cbf1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0a76bc9a-fe1d-4a6b-aa6d-e147f8c1cbf1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:57 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-0a76bc9a-fe1d-4a6b-aa6d-e147f8c1cbf1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] HTTP exception thrown: Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 could not be found. Apr 13 23:16:57 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-0a76bc9a-fe1d-4a6b-aa6d-e147f8c1cbf1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Request method failure captured: Apr 13 23:16:57 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/7226cc11-4c2c-4a27-bb02-87ba1f749d33 HTTP/1.1 Apr 13 23:16:57 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:16:57 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:16:57 user devstack@n-api.service[61612]: Connection: close Apr 13 23:16:57 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:16:57 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:16:57 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:16:57 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:16:57 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:16:57 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIifwYhN3QvK0EhykzFHzX6u9gISN6-H09EezHTqcbEyy0QE9XgDwvm06RN3jmkmIYNViVv-Z-47XPn4j5od4Ulq6w1Gj__pMgqiEa-FbJIO-yHvFAv4BXbrWs5AMcyEj8N5T9u07OTbOTixM9hDbgogXfMepIRGgoGOFQOCLjS9ifs Apr 13 23:16:57 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:16:57 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:16:57 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:16:57 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:16:57 user devstack@n-api.service[61612]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 23:16:57 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:16:57 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:16:57 user devstack@n-api.service[61612]: X-Project-Id: 3fe77a2c491c4596ba7e6af3236d7de8 Apr 13 23:16:57 user devstack@n-api.service[61612]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1416841836 Apr 13 23:16:57 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:16:57 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:16:57 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3fe77a2c491c4596ba7e6af3236d7de8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3fe77a2c491c4596ba7e6af3236d7de8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3fe77a2c491c4596ba7e6af3236d7de8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:16:57 user devstack@n-api.service[61612]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1416841836 Apr 13 23:16:57 user devstack@n-api.service[61612]: X-Tenant-Id: 3fe77a2c491c4596ba7e6af3236d7de8 Apr 13 23:16:57 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1416841836 Apr 13 23:16:57 user devstack@n-api.service[61612]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member Apr 13 23:16:57 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:16:57 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:16:57 user devstack@n-api.service[61612]: X-User-Id: 6db44e7cb89a46c2999916b0a266b159 Apr 13 23:16:57 user devstack@n-api.service[61612]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member Apr 13 23:16:57 user devstack@n-api.service[61612]: method: > Apr 13 23:16:57 user devstack@n-api.service[61612]: exception: Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 could not be found. Apr 13 23:16:57 user devstack@n-api.service[61612]: action_args: {'id': '7226cc11-4c2c-4a27-bb02-87ba1f749d33'} Apr 13 23:16:57 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 could not be found. Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 could not be found. Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 could not be found. Apr 13 23:16:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:16:57 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-0a76bc9a-fe1d-4a6b-aa6d-e147f8c1cbf1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Returning 404 to user: Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:16:57 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-0a76bc9a-fe1d-4a6b-aa6d-e147f8c1cbf1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7226cc11-4c2c-4a27-bb02-87ba1f749d33" status: 404 len: 111 microversion: 2.87 time: 0.032581 Apr 13 23:16:57 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 315/950] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:16:57 2023] GET /compute/v2.1/servers/7226cc11-4c2c-4a27-bb02-87ba1f749d33 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:16:59 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-ad9b36c1-c647-4d31-ae40-6e15db357d6c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:16:59 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-ad9b36c1-c647-4d31-ae40-6e15db357d6c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:16:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ad9b36c1-c647-4d31-ae40-6e15db357d6c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ad9b36c1-c647-4d31-ae40-6e15db357d6c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ad9b36c1-c647-4d31-ae40-6e15db357d6c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ad9b36c1-c647-4d31-ae40-6e15db357d6c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ad9b36c1-c647-4d31-ae40-6e15db357d6c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ad9b36c1-c647-4d31-ae40-6e15db357d6c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:59 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-ad9b36c1-c647-4d31-ae40-6e15db357d6c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043951 Apr 13 23:16:59 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 321/951] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:16:59 2023] GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 23:16:59 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-28a5d4fb-4b8e-4493-a52c-d9425b4a9bd3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:16:59 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-28a5d4fb-4b8e-4493-a52c-d9425b4a9bd3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:16:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-28a5d4fb-4b8e-4493-a52c-d9425b4a9bd3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-28a5d4fb-4b8e-4493-a52c-d9425b4a9bd3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-28a5d4fb-4b8e-4493-a52c-d9425b4a9bd3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-28a5d4fb-4b8e-4493-a52c-d9425b4a9bd3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:16:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-28a5d4fb-4b8e-4493-a52c-d9425b4a9bd3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:16:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-28a5d4fb-4b8e-4493-a52c-d9425b4a9bd3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:16:59 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-28a5d4fb-4b8e-4493-a52c-d9425b4a9bd3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:16:59 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-28a5d4fb-4b8e-4493-a52c-d9425b4a9bd3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1728 microversion: 2.1 time: 0.164144 Apr 13 23:16:59 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 316/952] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:16:59 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:17:09 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:17:09 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:17:09 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-b0d638af-ec1c-41a0-9975-58f455c39577 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Action: 'create', calling method: .version_select at 0x7f3d1de95750>, body: {"keypair": {"name": "tempest-keypair-106580173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRHhnAKdZFUW2qGL3xJyfalvtnzUb12fQWEKaj1zVCyg5qFeLmoWDgWt5B/CDTEZ5VNMSCnig9fSEEvVhciP/p+fUw6A9lTrWimhc/xwqS7liP8+sW9m/AzIzM0EZ7OOg=="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:17:09 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-b0d638af-ec1c-41a0-9975-58f455c39577 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Getting quotas for project b9ad0d0e72ad43cca506267d62269910. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:17:09 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-b0d638af-ec1c-41a0-9975-58f455c39577 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Getting quotas for user e66f624501c3404bb1eb9412a8a6c951 and project b9ad0d0e72ad43cca506267d62269910. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:17:09 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-b0d638af-ec1c-41a0-9975-58f455c39577 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.166181 Apr 13 23:17:09 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 316/953] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 23:17:09 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 168 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 23:17:11 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-567976838", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301"}], "security_groups": [{"name": "tempest-securitygroup--1948894948"}], "key_name": "tempest-keypair-106580173", "user_data": "}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:17:11 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:17:11 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:17:11 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] validate_networks() for [('63f2f5eb-5e4d-439f-b38d-a0d5b96c5301', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:17:11 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:17:11 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:17:11 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:17:11 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:17:11 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:17:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:11 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Getting quotas for project b9ad0d0e72ad43cca506267d62269910. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:17:11 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Getting quotas for user e66f624501c3404bb1eb9412a8a6c951 and project b9ad0d0e72ad43cca506267d62269910. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:17:11 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:17:11 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:17:11 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.564878 Apr 13 23:17:11 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 322/954] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 23:17:11 2023] POST /compute/v2.1/servers => generated 400 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 23:17:11 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-861a9bff-f4e5-46fd-a50d-af79b22b464e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:17:11 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-861a9bff-f4e5-46fd-a50d-af79b22b464e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:17:11 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:17:11 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=14 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:17:11 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-861a9bff-f4e5-46fd-a50d-af79b22b464e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:17:11 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-861a9bff-f4e5-46fd-a50d-af79b22b464e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:17:11 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-861a9bff-f4e5-46fd-a50d-af79b22b464e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:17:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-861a9bff-f4e5-46fd-a50d-af79b22b464e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" status: 200 len: 1274 microversion: 2.20 time: 0.096879 Apr 13 23:17:11 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 317/955] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:17:11 2023] GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:17:14 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-a99eb5c0-1193-47b7-b764-615d39a25ee2 req-ea5f495c-9d93-4a3b-879f-a8d409b3ab6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55", "tag": "b3a3698d-6a99-43ff-8298-a59026248b01"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:17:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a99eb5c0-1193-47b7-b764-615d39a25ee2 req-ea5f495c-9d93-4a3b-879f-a8d409b3ab6a service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a99eb5c0-1193-47b7-b764-615d39a25ee2 req-ea5f495c-9d93-4a3b-879f-a8d409b3ab6a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:14 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a99eb5c0-1193-47b7-b764-615d39a25ee2 req-ea5f495c-9d93-4a3b-879f-a8d409b3ab6a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:14 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-a99eb5c0-1193-47b7-b764-615d39a25ee2 req-ea5f495c-9d93-4a3b-879f-a8d409b3ab6a service nova] Creating event network-changed:b3a3698d-6a99-43ff-8298-a59026248b01 for instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 on user Apr 13 23:17:14 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-a99eb5c0-1193-47b7-b764-615d39a25ee2 req-ea5f495c-9d93-4a3b-879f-a8d409b3ab6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.026980 Apr 13 23:17:14 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 317/956] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:17:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:17:16 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-2afb6155-71e7-4209-b5ac-a36d597e4634 req-b29d7cd0-643e-4773-b8ee-3624a109eb8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55", "name": "network-vif-plugged", "status": "completed", "tag": "b3a3698d-6a99-43ff-8298-a59026248b01"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:17:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2afb6155-71e7-4209-b5ac-a36d597e4634 req-b29d7cd0-643e-4773-b8ee-3624a109eb8e service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2afb6155-71e7-4209-b5ac-a36d597e4634 req-b29d7cd0-643e-4773-b8ee-3624a109eb8e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2afb6155-71e7-4209-b5ac-a36d597e4634 req-b29d7cd0-643e-4773-b8ee-3624a109eb8e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-2afb6155-71e7-4209-b5ac-a36d597e4634 req-b29d7cd0-643e-4773-b8ee-3624a109eb8e service nova] Creating event network-vif-plugged:b3a3698d-6a99-43ff-8298-a59026248b01 for instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 on user Apr 13 23:17:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-2afb6155-71e7-4209-b5ac-a36d597e4634 req-b29d7cd0-643e-4773-b8ee-3624a109eb8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050925 Apr 13 23:17:16 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 323/957] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:17:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:17:17 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-cd2073f3-4e72-4c21-ba13-724f93df9d46 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:17:17 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-cd2073f3-4e72-4c21-ba13-724f93df9d46 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:17:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cd2073f3-4e72-4c21-ba13-724f93df9d46 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cd2073f3-4e72-4c21-ba13-724f93df9d46 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cd2073f3-4e72-4c21-ba13-724f93df9d46 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cd2073f3-4e72-4c21-ba13-724f93df9d46 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cd2073f3-4e72-4c21-ba13-724f93df9d46 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cd2073f3-4e72-4c21-ba13-724f93df9d46 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:17 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-cd2073f3-4e72-4c21-ba13-724f93df9d46 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17551363dd9f4e219ad7198b21509e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71645bbbfcc4e41994fe910043ca0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:17:17 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-cd2073f3-4e72-4c21-ba13-724f93df9d46 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26" status: 200 len: 1537 microversion: 2.1 time: 0.136293 Apr 13 23:17:17 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 318/958] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:17:17 2023] GET /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26 => generated 1537 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:17:18 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-c550c57d-fd1b-4805-9e82-921becf259be req-3d8125cf-a5d2-4631-8d35-128d9250f0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55", "name": "network-vif-plugged", "status": "completed", "tag": "b3a3698d-6a99-43ff-8298-a59026248b01"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:17:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c550c57d-fd1b-4805-9e82-921becf259be req-3d8125cf-a5d2-4631-8d35-128d9250f0a6 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c550c57d-fd1b-4805-9e82-921becf259be req-3d8125cf-a5d2-4631-8d35-128d9250f0a6 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c550c57d-fd1b-4805-9e82-921becf259be req-3d8125cf-a5d2-4631-8d35-128d9250f0a6 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:18 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-c550c57d-fd1b-4805-9e82-921becf259be req-3d8125cf-a5d2-4631-8d35-128d9250f0a6 service nova] Creating event network-vif-plugged:b3a3698d-6a99-43ff-8298-a59026248b01 for instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 on user Apr 13 23:17:18 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-c550c57d-fd1b-4805-9e82-921becf259be req-3d8125cf-a5d2-4631-8d35-128d9250f0a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029326 Apr 13 23:17:18 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 318/959] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:17:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:17:18 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-6052dece-9840-4765-a905-9ded422c2402 req-f117e424-8aac-47cc-aea1-b70185efa89f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9de39303-da44-47ae-adef-ff80f0b792a7", "tag": "16379ba5-9e41-4846-9ac8-8b5e86b776c0"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:17:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6052dece-9840-4765-a905-9ded422c2402 req-f117e424-8aac-47cc-aea1-b70185efa89f service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6052dece-9840-4765-a905-9ded422c2402 req-f117e424-8aac-47cc-aea1-b70185efa89f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6052dece-9840-4765-a905-9ded422c2402 req-f117e424-8aac-47cc-aea1-b70185efa89f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:18 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-6052dece-9840-4765-a905-9ded422c2402 req-f117e424-8aac-47cc-aea1-b70185efa89f service nova] Creating event network-changed:16379ba5-9e41-4846-9ac8-8b5e86b776c0 for instance 9de39303-da44-47ae-adef-ff80f0b792a7 on user Apr 13 23:17:18 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-6052dece-9840-4765-a905-9ded422c2402 req-f117e424-8aac-47cc-aea1-b70185efa89f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049920 Apr 13 23:17:18 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 324/960] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:17:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:17:19 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-6e82f7d2-2503-4a87-96d2-5f23dd0e8561 req-291cffeb-2538-49cc-b568-96b883380a51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f522c0be-7d51-421c-8d6c-d01ce6f6eb26", "tag": "319f1294-7d2b-4725-8ecd-a21ef3df06e8"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:17:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-6e82f7d2-2503-4a87-96d2-5f23dd0e8561 req-291cffeb-2538-49cc-b568-96b883380a51 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-6e82f7d2-2503-4a87-96d2-5f23dd0e8561 req-291cffeb-2538-49cc-b568-96b883380a51 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-6e82f7d2-2503-4a87-96d2-5f23dd0e8561 req-291cffeb-2538-49cc-b568-96b883380a51 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-6e82f7d2-2503-4a87-96d2-5f23dd0e8561 req-291cffeb-2538-49cc-b568-96b883380a51 service nova] Creating event network-changed:319f1294-7d2b-4725-8ecd-a21ef3df06e8 for instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 on user Apr 13 23:17:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-6e82f7d2-2503-4a87-96d2-5f23dd0e8561 req-291cffeb-2538-49cc-b568-96b883380a51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031841 Apr 13 23:17:19 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 319/961] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:17:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:17:20 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:17:20 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b781e478-ccad-4879-a98b-59c42a5c8b70"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:17:20 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:17:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:20 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.369174 Apr 13 23:17:20 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 319/962] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 23:17:20 2023] POST /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/os-volume_attachments => generated 194 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:17:21 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:17:21 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:17:21 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:17:21 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:17:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:21 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:21 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:17:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7" status: 204 len: 0 microversion: 2.1 time: 0.154792 Apr 13 23:17:22 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 325/963] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:17:21 2023] DELETE /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 13 23:17:22 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:17:22 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f1d6fcd9-7a7f-4283-ae03-b7caed9ef2c6 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:17:22 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f1d6fcd9-7a7f-4283-ae03-b7caed9ef2c6 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:17:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f1d6fcd9-7a7f-4283-ae03-b7caed9ef2c6 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f1d6fcd9-7a7f-4283-ae03-b7caed9ef2c6 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f1d6fcd9-7a7f-4283-ae03-b7caed9ef2c6 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f1d6fcd9-7a7f-4283-ae03-b7caed9ef2c6 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f1d6fcd9-7a7f-4283-ae03-b7caed9ef2c6 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f1d6fcd9-7a7f-4283-ae03-b7caed9ef2c6 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:22 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-f1d6fcd9-7a7f-4283-ae03-b7caed9ef2c6 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6385ae82042ad9682f7728b8263da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f4ef55afe342ebb945ad336e01582a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:17:22 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f1d6fcd9-7a7f-4283-ae03-b7caed9ef2c6 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7" status: 200 len: 1573 microversion: 2.1 time: 0.260696 Apr 13 23:17:22 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 320/964] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:17:22 2023] GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7 => generated 1573 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:17:22 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-e3d2e34a-2626-4645-a963-ad5db7b9428e req-45d6f98e-bcc8-4e13-8149-61c34afb8ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9de39303-da44-47ae-adef-ff80f0b792a7", "name": "network-vif-unplugged", "status": "completed", "tag": "16379ba5-9e41-4846-9ac8-8b5e86b776c0"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:17:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e3d2e34a-2626-4645-a963-ad5db7b9428e req-45d6f98e-bcc8-4e13-8149-61c34afb8ae0 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e3d2e34a-2626-4645-a963-ad5db7b9428e req-45d6f98e-bcc8-4e13-8149-61c34afb8ae0 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e3d2e34a-2626-4645-a963-ad5db7b9428e req-45d6f98e-bcc8-4e13-8149-61c34afb8ae0 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:22 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-e3d2e34a-2626-4645-a963-ad5db7b9428e req-45d6f98e-bcc8-4e13-8149-61c34afb8ae0 service nova] Creating event network-vif-unplugged:16379ba5-9e41-4846-9ac8-8b5e86b776c0 for instance 9de39303-da44-47ae-adef-ff80f0b792a7 on user Apr 13 23:17:22 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-e3d2e34a-2626-4645-a963-ad5db7b9428e req-45d6f98e-bcc8-4e13-8149-61c34afb8ae0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036615 Apr 13 23:17:22 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 320/965] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:17:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 23:17:23 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-056ba109-fa91-4d85-a516-190f509844ee req-790b0080-36c7-4e79-a555-2862d86e7ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9de39303-da44-47ae-adef-ff80f0b792a7", "name": "network-vif-deleted", "tag": "16379ba5-9e41-4846-9ac8-8b5e86b776c0"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:17:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-056ba109-fa91-4d85-a516-190f509844ee req-790b0080-36c7-4e79-a555-2862d86e7ef7 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-056ba109-fa91-4d85-a516-190f509844ee req-790b0080-36c7-4e79-a555-2862d86e7ef7 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-056ba109-fa91-4d85-a516-190f509844ee req-790b0080-36c7-4e79-a555-2862d86e7ef7 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:23 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-056ba109-fa91-4d85-a516-190f509844ee req-790b0080-36c7-4e79-a555-2862d86e7ef7 service nova] Creating event network-vif-deleted:16379ba5-9e41-4846-9ac8-8b5e86b776c0 for instance 9de39303-da44-47ae-adef-ff80f0b792a7 on user Apr 13 23:17:23 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-056ba109-fa91-4d85-a516-190f509844ee req-790b0080-36c7-4e79-a555-2862d86e7ef7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041897 Apr 13 23:17:23 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 326/966] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:17:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:17:24 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-346ce5b0-dd07-4fd4-908c-6e6d742c35f4 req-8fba519b-e1fc-42bb-ac29-58d97f91748d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9de39303-da44-47ae-adef-ff80f0b792a7", "name": "network-vif-plugged", "status": "completed", "tag": "16379ba5-9e41-4846-9ac8-8b5e86b776c0"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:17:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-346ce5b0-dd07-4fd4-908c-6e6d742c35f4 req-8fba519b-e1fc-42bb-ac29-58d97f91748d service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-346ce5b0-dd07-4fd4-908c-6e6d742c35f4 req-8fba519b-e1fc-42bb-ac29-58d97f91748d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-346ce5b0-dd07-4fd4-908c-6e6d742c35f4 req-8fba519b-e1fc-42bb-ac29-58d97f91748d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:24 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-346ce5b0-dd07-4fd4-908c-6e6d742c35f4 req-8fba519b-e1fc-42bb-ac29-58d97f91748d service nova] Creating event network-vif-plugged:16379ba5-9e41-4846-9ac8-8b5e86b776c0 for instance 9de39303-da44-47ae-adef-ff80f0b792a7 on user Apr 13 23:17:24 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-346ce5b0-dd07-4fd4-908c-6e6d742c35f4 req-8fba519b-e1fc-42bb-ac29-58d97f91748d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028344 Apr 13 23:17:24 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 321/967] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:17:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:17:29 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:17:29 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:17:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:29 user devstack@n-api.service[61612]: DEBUG nova.objects.instance [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lazy-loading 'services' on Instance uuid f522c0be-7d51-421c-8d6c-d01ce6f6eb26 {{(pid=61612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:17:30 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/os-volume_attachments/b781e478-ccad-4879-a98b-59c42a5c8b70" status: 202 len: 0 microversion: 2.1 time: 0.228657 Apr 13 23:17:30 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 321/968] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 23:17:29 2023] DELETE /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/os-volume_attachments/b781e478-ccad-4879-a98b-59c42a5c8b70 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:17:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-3190443b-db98-47a9-9a0b-478f85d56a31 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:17:30 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-3190443b-db98-47a9-9a0b-478f85d56a31 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:17:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3190443b-db98-47a9-9a0b-478f85d56a31 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3190443b-db98-47a9-9a0b-478f85d56a31 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3190443b-db98-47a9-9a0b-478f85d56a31 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3190443b-db98-47a9-9a0b-478f85d56a31 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3190443b-db98-47a9-9a0b-478f85d56a31 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3190443b-db98-47a9-9a0b-478f85d56a31 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:30 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-3190443b-db98-47a9-9a0b-478f85d56a31 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080779 Apr 13 23:17:30 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 327/969] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:17:30 2023] GET /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:17:42 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-87b943ae-388b-4d73-884a-9b6a1be07cf4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:17:42 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-87b943ae-388b-4d73-884a-9b6a1be07cf4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:17:42 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=12 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:17:42 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=16 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:17:42 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-87b943ae-388b-4d73-884a-9b6a1be07cf4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:42 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-87b943ae-388b-4d73-884a-9b6a1be07cf4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:42 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-87b943ae-388b-4d73-884a-9b6a1be07cf4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:42 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-87b943ae-388b-4d73-884a-9b6a1be07cf4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:42 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-87b943ae-388b-4d73-884a-9b6a1be07cf4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:42 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-87b943ae-388b-4d73-884a-9b6a1be07cf4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:42 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-87b943ae-388b-4d73-884a-9b6a1be07cf4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] HTTP exception thrown: Instance 08e157a4-85f9-466f-b02c-fd0fc629b302 could not be found. Apr 13 23:17:42 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-87b943ae-388b-4d73-884a-9b6a1be07cf4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Request method failure captured: Apr 13 23:17:42 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/08e157a4-85f9-466f-b02c-fd0fc629b302 HTTP/1.1 Apr 13 23:17:42 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:17:42 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:17:42 user devstack@n-api.service[61611]: Connection: close Apr 13 23:17:42 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:17:42 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:17:42 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:17:42 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:17:42 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:17:42 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIwQr2-3QzekRfWdkf-YWXAh0-1VJpLk5IdQPw9Ma1Sm0pk2a1vb9FBFAAYUbAgyRrcD3g8QDdehhZnHB2gqI_hO2qSnczuY0KYKbE41ydvTEHfI8SyZ5VmSfCNFyH3MWOQcHCvXVWGRuSdYluUs8zwX946xG_yfBKxBHNxNQPvUTCk Apr 13 23:17:42 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:17:42 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:17:42 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:17:42 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:17:42 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:17:42 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:17:42 user devstack@n-api.service[61611]: X-Project-Id: 5cebfec442634e41b173904833269463 Apr 13 23:17:42 user devstack@n-api.service[61611]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1344748200 Apr 13 23:17:42 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:17:42 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:17:42 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5cebfec442634e41b173904833269463"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5cebfec442634e41b173904833269463"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5cebfec442634e41b173904833269463"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:17:42 user devstack@n-api.service[61611]: X-Tenant: tempest-VolumesSnapshotTestJSON-1344748200 Apr 13 23:17:42 user devstack@n-api.service[61611]: X-Tenant-Id: 5cebfec442634e41b173904833269463 Apr 13 23:17:42 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1344748200 Apr 13 23:17:42 user devstack@n-api.service[61611]: X-User: tempest-VolumesSnapshotTestJSON-1344748200-project-member Apr 13 23:17:42 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:17:42 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:17:42 user devstack@n-api.service[61611]: X-User-Id: 5a1420e7febd479e8f23ad9784950f65 Apr 13 23:17:42 user devstack@n-api.service[61611]: X-User-Name: tempest-VolumesSnapshotTestJSON-1344748200-project-member Apr 13 23:17:42 user devstack@n-api.service[61611]: method: > Apr 13 23:17:42 user devstack@n-api.service[61611]: exception: Instance 08e157a4-85f9-466f-b02c-fd0fc629b302 could not be found. Apr 13 23:17:42 user devstack@n-api.service[61611]: action_args: {'id': '08e157a4-85f9-466f-b02c-fd0fc629b302'} Apr 13 23:17:42 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08e157a4-85f9-466f-b02c-fd0fc629b302 could not be found. Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08e157a4-85f9-466f-b02c-fd0fc629b302 could not be found. Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08e157a4-85f9-466f-b02c-fd0fc629b302 could not be found. Apr 13 23:17:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:17:42 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-87b943ae-388b-4d73-884a-9b6a1be07cf4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Returning 404 to user: Instance 08e157a4-85f9-466f-b02c-fd0fc629b302 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:17:42 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-87b943ae-388b-4d73-884a-9b6a1be07cf4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08e157a4-85f9-466f-b02c-fd0fc629b302" status: 404 len: 111 microversion: 2.1 time: 0.031488 Apr 13 23:17:42 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 322/970] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:17:41 2023] GET /compute/v2.1/servers/08e157a4-85f9-466f-b02c-fd0fc629b302 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:17:59 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:17:59 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:17:59 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:17:59 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:17:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:59 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/action" status: 202 len: 0 microversion: 2.1 time: 0.165795 Apr 13 23:17:59 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 322/971] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 23:17:59 2023] POST /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:17:59 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-1a18677e-0af9-438e-9bec-6deaf58ddf9e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:17:59 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-1a18677e-0af9-438e-9bec-6deaf58ddf9e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:17:59 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:17:59 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:17:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a18677e-0af9-438e-9bec-6deaf58ddf9e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a18677e-0af9-438e-9bec-6deaf58ddf9e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a18677e-0af9-438e-9bec-6deaf58ddf9e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:17:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a18677e-0af9-438e-9bec-6deaf58ddf9e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:17:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a18677e-0af9-438e-9bec-6deaf58ddf9e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:17:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a18677e-0af9-438e-9bec-6deaf58ddf9e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:00 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-1a18677e-0af9-438e-9bec-6deaf58ddf9e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:18:00 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-1a18677e-0af9-438e-9bec-6deaf58ddf9e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1727 microversion: 2.1 time: 0.234175 Apr 13 23:18:00 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 328/972] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:17:59 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1727 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:18:01 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-2f492b13-2d91-4af8-a6ca-24bc84ba87ec req-36215c49-7d23-4fe0-9978-97eb3c79e4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d", "name": "network-vif-unplugged", "status": "completed", "tag": "09cc0c17-bd49-4207-9de4-89178a1e681e"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:18:01 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:18:01 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:18:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-2f492b13-2d91-4af8-a6ca-24bc84ba87ec req-36215c49-7d23-4fe0-9978-97eb3c79e4b8 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-2f492b13-2d91-4af8-a6ca-24bc84ba87ec req-36215c49-7d23-4fe0-9978-97eb3c79e4b8 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-2f492b13-2d91-4af8-a6ca-24bc84ba87ec req-36215c49-7d23-4fe0-9978-97eb3c79e4b8 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:01 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-2f492b13-2d91-4af8-a6ca-24bc84ba87ec req-36215c49-7d23-4fe0-9978-97eb3c79e4b8 service nova] Creating event network-vif-unplugged:09cc0c17-bd49-4207-9de4-89178a1e681e for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d on user Apr 13 23:18:01 user devstack@n-api.service[61611]: DEBUG nova.compute.api [req-2f492b13-2d91-4af8-a6ca-24bc84ba87ec req-36215c49-7d23-4fe0-9978-97eb3c79e4b8 service nova] Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61611) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 23:18:01 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-2f492b13-2d91-4af8-a6ca-24bc84ba87ec req-36215c49-7d23-4fe0-9978-97eb3c79e4b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049881 Apr 13 23:18:01 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 323/973] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:18:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:18:01 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-b9597399-8455-41fe-a30a-93128ffe0103 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:18:01 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-b9597399-8455-41fe-a30a-93128ffe0103 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:18:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b9597399-8455-41fe-a30a-93128ffe0103 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b9597399-8455-41fe-a30a-93128ffe0103 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b9597399-8455-41fe-a30a-93128ffe0103 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b9597399-8455-41fe-a30a-93128ffe0103 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b9597399-8455-41fe-a30a-93128ffe0103 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b9597399-8455-41fe-a30a-93128ffe0103 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:02 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-b9597399-8455-41fe-a30a-93128ffe0103 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:18:02 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-b9597399-8455-41fe-a30a-93128ffe0103 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:18:02 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-b9597399-8455-41fe-a30a-93128ffe0103 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:18:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-b9597399-8455-41fe-a30a-93128ffe0103 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" status: 200 len: 1584 microversion: 2.20 time: 0.154872 Apr 13 23:18:02 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 323/974] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:18:01 2023] GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 => generated 1584 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:18:03 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-d9b94e4a-f8d1-4dcd-a5d7-c24da2145b76 req-70d9f5ca-1750-4d75-8d43-eb27a05f9763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d", "name": "network-vif-plugged", "status": "completed", "tag": "09cc0c17-bd49-4207-9de4-89178a1e681e"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:18:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d9b94e4a-f8d1-4dcd-a5d7-c24da2145b76 req-70d9f5ca-1750-4d75-8d43-eb27a05f9763 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d9b94e4a-f8d1-4dcd-a5d7-c24da2145b76 req-70d9f5ca-1750-4d75-8d43-eb27a05f9763 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d9b94e4a-f8d1-4dcd-a5d7-c24da2145b76 req-70d9f5ca-1750-4d75-8d43-eb27a05f9763 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:03 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-d9b94e4a-f8d1-4dcd-a5d7-c24da2145b76 req-70d9f5ca-1750-4d75-8d43-eb27a05f9763 service nova] Creating event network-vif-plugged:09cc0c17-bd49-4207-9de4-89178a1e681e for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d on user Apr 13 23:18:03 user devstack@n-api.service[61613]: DEBUG nova.compute.api [req-d9b94e4a-f8d1-4dcd-a5d7-c24da2145b76 req-70d9f5ca-1750-4d75-8d43-eb27a05f9763 service nova] Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 23:18:03 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-d9b94e4a-f8d1-4dcd-a5d7-c24da2145b76 req-70d9f5ca-1750-4d75-8d43-eb27a05f9763 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049927 Apr 13 23:18:03 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 329/975] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:18:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:18:11 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-5dd4afa5-31d3-4963-b9b9-7c1ca8ab5337 req-0d154975-b76b-4db0-9f75-a8957ea9cc22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d", "name": "network-vif-plugged", "status": "completed", "tag": "09cc0c17-bd49-4207-9de4-89178a1e681e"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:18:11 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:18:11 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:18:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5dd4afa5-31d3-4963-b9b9-7c1ca8ab5337 req-0d154975-b76b-4db0-9f75-a8957ea9cc22 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5dd4afa5-31d3-4963-b9b9-7c1ca8ab5337 req-0d154975-b76b-4db0-9f75-a8957ea9cc22 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5dd4afa5-31d3-4963-b9b9-7c1ca8ab5337 req-0d154975-b76b-4db0-9f75-a8957ea9cc22 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-5dd4afa5-31d3-4963-b9b9-7c1ca8ab5337 req-0d154975-b76b-4db0-9f75-a8957ea9cc22 service nova] Creating event network-vif-plugged:09cc0c17-bd49-4207-9de4-89178a1e681e for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d on user Apr 13 23:18:11 user devstack@n-api.service[61611]: DEBUG nova.compute.api [req-5dd4afa5-31d3-4963-b9b9-7c1ca8ab5337 req-0d154975-b76b-4db0-9f75-a8957ea9cc22 service nova] Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61611) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 23:18:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-5dd4afa5-31d3-4963-b9b9-7c1ca8ab5337 req-0d154975-b76b-4db0-9f75-a8957ea9cc22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107059 Apr 13 23:18:11 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 324/976] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:18:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:18:12 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-b490c6c1-a31e-4c8e-ab0e-3eb7e6903a01 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:18:12 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-b490c6c1-a31e-4c8e-ab0e-3eb7e6903a01 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:18:12 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:18:12 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:18:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b490c6c1-a31e-4c8e-ab0e-3eb7e6903a01 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b490c6c1-a31e-4c8e-ab0e-3eb7e6903a01 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b490c6c1-a31e-4c8e-ab0e-3eb7e6903a01 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b490c6c1-a31e-4c8e-ab0e-3eb7e6903a01 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b490c6c1-a31e-4c8e-ab0e-3eb7e6903a01 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b490c6c1-a31e-4c8e-ab0e-3eb7e6903a01 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:12 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-b490c6c1-a31e-4c8e-ab0e-3eb7e6903a01 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] HTTP exception thrown: Instance 9de39303-da44-47ae-adef-ff80f0b792a7 could not be found. Apr 13 23:18:12 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-b490c6c1-a31e-4c8e-ab0e-3eb7e6903a01 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Request method failure captured: Apr 13 23:18:12 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7 HTTP/1.1 Apr 13 23:18:12 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:18:12 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:18:12 user devstack@n-api.service[61612]: Connection: close Apr 13 23:18:12 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:18:12 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:18:12 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:18:12 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:18:12 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:18:12 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIvu9gGj0jGMQyB57QdMIbb9muicra8V8102USZsiYGTv0PleCDEejDl_VZAGrdPS0rQle4uAqjAvyM-kTnUiKTvsKxYyaB4mae12fvuczRJs1jhzq2lioR8W8DCT3lJxrBhr04PWytnwW7VYj8nnNlW2zgzImbSyXlja0xkoF1t-pY Apr 13 23:18:12 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:18:12 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:18:12 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:18:12 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:18:12 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:18:12 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:18:12 user devstack@n-api.service[61612]: X-Project-Id: 59f4ef55afe342ebb945ad336e01582a Apr 13 23:18:12 user devstack@n-api.service[61612]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1787800466 Apr 13 23:18:12 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:18:12 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:18:12 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/59f4ef55afe342ebb945ad336e01582a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/59f4ef55afe342ebb945ad336e01582a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/59f4ef55afe342ebb945ad336e01582a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:18:12 user devstack@n-api.service[61612]: X-Tenant: tempest-SnapshotDataIntegrityTests-1787800466 Apr 13 23:18:12 user devstack@n-api.service[61612]: X-Tenant-Id: 59f4ef55afe342ebb945ad336e01582a Apr 13 23:18:12 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1787800466 Apr 13 23:18:12 user devstack@n-api.service[61612]: X-User: tempest-SnapshotDataIntegrityTests-1787800466-project-member Apr 13 23:18:12 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:18:12 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:18:12 user devstack@n-api.service[61612]: X-User-Id: d2a6385ae82042ad9682f7728b8263da Apr 13 23:18:12 user devstack@n-api.service[61612]: X-User-Name: tempest-SnapshotDataIntegrityTests-1787800466-project-member Apr 13 23:18:12 user devstack@n-api.service[61612]: method: > Apr 13 23:18:12 user devstack@n-api.service[61612]: exception: Instance 9de39303-da44-47ae-adef-ff80f0b792a7 could not be found. Apr 13 23:18:12 user devstack@n-api.service[61612]: action_args: {'id': '9de39303-da44-47ae-adef-ff80f0b792a7'} Apr 13 23:18:12 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9de39303-da44-47ae-adef-ff80f0b792a7 could not be found. Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9de39303-da44-47ae-adef-ff80f0b792a7 could not be found. Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9de39303-da44-47ae-adef-ff80f0b792a7 could not be found. Apr 13 23:18:12 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:18:12 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-b490c6c1-a31e-4c8e-ab0e-3eb7e6903a01 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Returning 404 to user: Instance 9de39303-da44-47ae-adef-ff80f0b792a7 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:18:12 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-b490c6c1-a31e-4c8e-ab0e-3eb7e6903a01 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7" status: 404 len: 111 microversion: 2.1 time: 0.033668 Apr 13 23:18:12 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 324/977] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:18:12 2023] GET /compute/v2.1/servers/9de39303-da44-47ae-adef-ff80f0b792a7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:18:12 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5c108f46-7c57-4e6c-af2d-9fb9a7fc7698 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Calling method '.version_select at 0x7f3d1e1b3520>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:18:12 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-5c108f46-7c57-4e6c-af2d-9fb9a7fc7698 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1668706765" status: 202 len: 0 microversion: 2.1 time: 0.036129 Apr 13 23:18:12 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 330/978] 10.0.0.210 () {62 vars in 1355 bytes} [Thu Apr 13 23:18:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1668706765 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:18:14 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-2d559278-a431-434f-99c8-a5ae8eacb7fe req-083a073b-ad0e-4be9-b237-469206da5530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d", "name": "network-vif-plugged", "status": "completed", "tag": "09cc0c17-bd49-4207-9de4-89178a1e681e"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:18:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-2d559278-a431-434f-99c8-a5ae8eacb7fe req-083a073b-ad0e-4be9-b237-469206da5530 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-2d559278-a431-434f-99c8-a5ae8eacb7fe req-083a073b-ad0e-4be9-b237-469206da5530 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-2d559278-a431-434f-99c8-a5ae8eacb7fe req-083a073b-ad0e-4be9-b237-469206da5530 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:14 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-2d559278-a431-434f-99c8-a5ae8eacb7fe req-083a073b-ad0e-4be9-b237-469206da5530 service nova] Creating event network-vif-plugged:09cc0c17-bd49-4207-9de4-89178a1e681e for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d on user Apr 13 23:18:14 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-2d559278-a431-434f-99c8-a5ae8eacb7fe req-083a073b-ad0e-4be9-b237-469206da5530 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062836 Apr 13 23:18:14 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 325/979] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:18:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:18:20 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-2f6eaafe-cc8a-48b4-9954-3e6cb15cd395 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:18:20 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-2f6eaafe-cc8a-48b4-9954-3e6cb15cd395 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:18:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2f6eaafe-cc8a-48b4-9954-3e6cb15cd395 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2f6eaafe-cc8a-48b4-9954-3e6cb15cd395 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2f6eaafe-cc8a-48b4-9954-3e6cb15cd395 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2f6eaafe-cc8a-48b4-9954-3e6cb15cd395 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2f6eaafe-cc8a-48b4-9954-3e6cb15cd395 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2f6eaafe-cc8a-48b4-9954-3e6cb15cd395 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:20 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-2f6eaafe-cc8a-48b4-9954-3e6cb15cd395 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042339 Apr 13 23:18:20 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 325/980] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:18:20 2023] GET /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 23:18:23 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=10 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:18:23 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:18:23 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-128925242"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:18:23 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:18:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:24 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/action" status: 202 len: 0 microversion: 2.1 time: 0.876648 Apr 13 23:18:24 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 331/981] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 23:18:23 2023] POST /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/action => generated 0 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 13 23:18:30 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:18:30 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:18:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-455b5d37-9c6c-4732-8d7a-ea50a5a7760e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Action: 'create', calling method: .version_select at 0x7f3d1c3fe320>, body: {"keypair": {"name": "tempest-TestShelveInstance-1980593566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvcgABwMirIcE19N+aazLx0Zg51+obS69YGRl6d0PeLCmslra6FLm+QyggrY60hO14lhcjk64wNOa7203g364QXdlHw2OjXK932WJyS+1PEJhGR3jaPzH4rq5v9Sj3ICQ=="}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:18:30 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-455b5d37-9c6c-4732-8d7a-ea50a5a7760e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Getting quotas for project 405da8dd69654b3fb74203d0b7e26ad2. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:18:30 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-455b5d37-9c6c-4732-8d7a-ea50a5a7760e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Getting quotas for user 271839d0073b49689368301d420c588a and project 405da8dd69654b3fb74203d0b7e26ad2. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:18:30 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-455b5d37-9c6c-4732-8d7a-ea50a5a7760e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.170683 Apr 13 23:18:30 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 326/982] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 23:18:30 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:18:34 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1940780057", "imageRef": "59b1def6-7e36-4983-81ea-7b924ee9a11c", "flavorRef": "42", "key_name": "tempest-TestStampPattern-668013808", "security_groups": [{"name": "tempest-secgroup-smoke-477866808"}], "networks": [{"uuid": "077aa2c8-8cb6-4692-92ba-82064a0163d2"}]}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:18:34 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:18:34 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=8 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:18:34 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] validate_networks() for [('077aa2c8-8cb6-4692-92ba-82064a0163d2', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:18:35 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:18:35 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:18:35 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:18:35 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:18:35 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:18:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:35 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Getting quotas for project a71645bbbfcc4e41994fe910043ca0dd. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:18:35 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Getting quotas for user 17551363dd9f4e219ad7198b21509e48 and project a71645bbbfcc4e41994fe910043ca0dd. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:18:35 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:18:35 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='59b1def6-7e36-4983-81ea-7b924ee9a11c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:18:35 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.776124 Apr 13 23:18:35 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 326/983] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:18:34 2023] POST /compute/v2.1/servers => generated 403 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:18:35 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:18:35 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:18:35 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e2833a44-2db1-45f3-af92-d434f57fa651 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:18:35 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-e2833a44-2db1-45f3-af92-d434f57fa651 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:18:35 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-e2833a44-2db1-45f3-af92-d434f57fa651 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17551363dd9f4e219ad7198b21509e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71645bbbfcc4e41994fe910043ca0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:18:35 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-e2833a44-2db1-45f3-af92-d434f57fa651 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f" status: 200 len: 1236 microversion: 2.1 time: 0.131322 Apr 13 23:18:35 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 332/984] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:18:35 2023] GET /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f => generated 1236 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:18:36 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-93864092", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-1980593566", "security_groups": [{"name": "tempest-secgroup-smoke-2079725311"}], "networks": [{"uuid": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f"}], "block_device_mapping_v2": [{"uuid": "b88ed41a-5418-4d62-a2fa-2a20ebb28d61", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:18:36 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] validate_networks() for [('8a45c5ee-8ca2-4056-becb-8c2011efdf1f', None, None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:18:37 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:18:37 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:18:37 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:18:37 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:18:37 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:18:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:37 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Getting quotas for project 405da8dd69654b3fb74203d0b7e26ad2. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:18:37 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Getting quotas for user 271839d0073b49689368301d420c588a and project 405da8dd69654b3fb74203d0b7e26ad2. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:18:37 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:18:37 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b88ed41a-5418-4d62-a2fa-2a20ebb28d61',volume_size=None,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:18:37 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.041294 Apr 13 23:18:37 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 327/985] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:18:36 2023] POST /compute/v2.1/servers => generated 404 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:18:37 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-cab8c97a-eb60-4835-acfc-fb8465a38c95 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:18:37 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-cab8c97a-eb60-4835-acfc-fb8465a38c95 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:18:37 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-cab8c97a-eb60-4835-acfc-fb8465a38c95 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271839d0073b49689368301d420c588a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405da8dd69654b3fb74203d0b7e26ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:18:37 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-cab8c97a-eb60-4835-acfc-fb8465a38c95 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6" status: 200 len: 1082 microversion: 2.1 time: 0.088583 Apr 13 23:18:37 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 327/986] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:18:37 2023] GET /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6 => generated 1082 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:18:38 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-6ef29196-eb64-4b23-a831-f68e37956a9d req-2eba2895-1c6f-45fd-ba61-61ea002915b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06283ac1-5795-455d-9f85-38880202537f", "tag": "5fc574ab-be44-4634-ba3f-ac0faf630044"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:18:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6ef29196-eb64-4b23-a831-f68e37956a9d req-2eba2895-1c6f-45fd-ba61-61ea002915b6 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6ef29196-eb64-4b23-a831-f68e37956a9d req-2eba2895-1c6f-45fd-ba61-61ea002915b6 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6ef29196-eb64-4b23-a831-f68e37956a9d req-2eba2895-1c6f-45fd-ba61-61ea002915b6 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:38 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-6ef29196-eb64-4b23-a831-f68e37956a9d req-2eba2895-1c6f-45fd-ba61-61ea002915b6 service nova] Creating event network-changed:5fc574ab-be44-4634-ba3f-ac0faf630044 for instance 06283ac1-5795-455d-9f85-38880202537f on user Apr 13 23:18:38 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-6ef29196-eb64-4b23-a831-f68e37956a9d req-2eba2895-1c6f-45fd-ba61-61ea002915b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084533 Apr 13 23:18:38 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 333/987] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:18:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:18:40 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-35a68bfb-96ff-4716-9767-9c1ef998ee08 req-193b5c00-80c4-43bd-bcac-d93fde617410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06283ac1-5795-455d-9f85-38880202537f", "name": "network-vif-plugged", "status": "completed", "tag": "5fc574ab-be44-4634-ba3f-ac0faf630044"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:18:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-35a68bfb-96ff-4716-9767-9c1ef998ee08 req-193b5c00-80c4-43bd-bcac-d93fde617410 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-35a68bfb-96ff-4716-9767-9c1ef998ee08 req-193b5c00-80c4-43bd-bcac-d93fde617410 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-35a68bfb-96ff-4716-9767-9c1ef998ee08 req-193b5c00-80c4-43bd-bcac-d93fde617410 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:40 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-35a68bfb-96ff-4716-9767-9c1ef998ee08 req-193b5c00-80c4-43bd-bcac-d93fde617410 service nova] Creating event network-vif-plugged:5fc574ab-be44-4634-ba3f-ac0faf630044 for instance 06283ac1-5795-455d-9f85-38880202537f on user Apr 13 23:18:40 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-35a68bfb-96ff-4716-9767-9c1ef998ee08 req-193b5c00-80c4-43bd-bcac-d93fde617410 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031774 Apr 13 23:18:40 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 328/988] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:18:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:18:42 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06283ac1-5795-455d-9f85-38880202537f", "name": "network-vif-plugged", "status": "completed", "tag": "5fc574ab-be44-4634-ba3f-ac0faf630044"}, {"name": "network-changed", "server_uuid": "04eb8a55-c6d2-4a80-a818-060635d757a6", "tag": "60b18b3d-d206-49a4-81e4-f29a1b538a3c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:18:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:42 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] Creating event network-vif-plugged:5fc574ab-be44-4634-ba3f-ac0faf630044 for instance 06283ac1-5795-455d-9f85-38880202537f on user Apr 13 23:18:42 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] Creating event network-changed:60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance 04eb8a55-c6d2-4a80-a818-060635d757a6 on user Apr 13 23:18:42 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.036722 Apr 13 23:18:42 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 328/989] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:18:42 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:18:46 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-78cb0760-0256-4e63-89b2-2bff13ca8969 req-864a892c-a136-40a3-8962-8d6e4cacf099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04eb8a55-c6d2-4a80-a818-060635d757a6", "name": "network-vif-plugged", "status": "completed", "tag": "60b18b3d-d206-49a4-81e4-f29a1b538a3c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:18:46 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:18:46 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-78cb0760-0256-4e63-89b2-2bff13ca8969 req-864a892c-a136-40a3-8962-8d6e4cacf099 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:46 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-78cb0760-0256-4e63-89b2-2bff13ca8969 req-864a892c-a136-40a3-8962-8d6e4cacf099 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:46 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-78cb0760-0256-4e63-89b2-2bff13ca8969 req-864a892c-a136-40a3-8962-8d6e4cacf099 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:46 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-78cb0760-0256-4e63-89b2-2bff13ca8969 req-864a892c-a136-40a3-8962-8d6e4cacf099 service nova] Creating event network-vif-plugged:60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance 04eb8a55-c6d2-4a80-a818-060635d757a6 on user Apr 13 23:18:46 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-78cb0760-0256-4e63-89b2-2bff13ca8969 req-864a892c-a136-40a3-8962-8d6e4cacf099 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052410 Apr 13 23:18:46 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 334/990] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:18:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 23:18:48 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:18:48 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=10 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:18:48 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-155c5e0d-5b89-4cf8-af88-9f20b7511fa9 req-a8142bab-7c43-471a-b662-4d18f97ed492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04eb8a55-c6d2-4a80-a818-060635d757a6", "name": "network-vif-plugged", "status": "completed", "tag": "60b18b3d-d206-49a4-81e4-f29a1b538a3c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:18:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-155c5e0d-5b89-4cf8-af88-9f20b7511fa9 req-a8142bab-7c43-471a-b662-4d18f97ed492 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-155c5e0d-5b89-4cf8-af88-9f20b7511fa9 req-a8142bab-7c43-471a-b662-4d18f97ed492 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-155c5e0d-5b89-4cf8-af88-9f20b7511fa9 req-a8142bab-7c43-471a-b662-4d18f97ed492 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:48 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-155c5e0d-5b89-4cf8-af88-9f20b7511fa9 req-a8142bab-7c43-471a-b662-4d18f97ed492 service nova] Creating event network-vif-plugged:60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance 04eb8a55-c6d2-4a80-a818-060635d757a6 on user Apr 13 23:18:48 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-155c5e0d-5b89-4cf8-af88-9f20b7511fa9 req-a8142bab-7c43-471a-b662-4d18f97ed492 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036555 Apr 13 23:18:48 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 329/991] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:18:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:18:50 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:18:50 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=8 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:18:50 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-37a24ed7-960d-4a1e-b155-691abadd0e84 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:18:50 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-37a24ed7-960d-4a1e-b155-691abadd0e84 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:18:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-37a24ed7-960d-4a1e-b155-691abadd0e84 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-37a24ed7-960d-4a1e-b155-691abadd0e84 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-37a24ed7-960d-4a1e-b155-691abadd0e84 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-37a24ed7-960d-4a1e-b155-691abadd0e84 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:18:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-37a24ed7-960d-4a1e-b155-691abadd0e84 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:18:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-37a24ed7-960d-4a1e-b155-691abadd0e84 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:18:50 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-37a24ed7-960d-4a1e-b155-691abadd0e84 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:18:50 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-37a24ed7-960d-4a1e-b155-691abadd0e84 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1720 microversion: 2.1 time: 0.187769 Apr 13 23:18:50 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 329/992] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:18:50 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:19:02 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=8 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:19:02 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:19:02 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-887ef0a1-b2b6-46f0-912f-175719c7f87c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:19:02 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-887ef0a1-b2b6-46f0-912f-175719c7f87c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:19:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-887ef0a1-b2b6-46f0-912f-175719c7f87c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-887ef0a1-b2b6-46f0-912f-175719c7f87c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-887ef0a1-b2b6-46f0-912f-175719c7f87c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-887ef0a1-b2b6-46f0-912f-175719c7f87c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-887ef0a1-b2b6-46f0-912f-175719c7f87c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-887ef0a1-b2b6-46f0-912f-175719c7f87c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-887ef0a1-b2b6-46f0-912f-175719c7f87c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.108406 Apr 13 23:19:02 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 335/993] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 23:19:02 2023] GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/os-interface => generated 282 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 23:19:02 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:19:02 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:19:02 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-4de5edb6-9db9-4464-920e-d122a9833ddd req-b8c6fb29-3019-4c66-80e8-a97377932b90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55", "tag": "b3a3698d-6a99-43ff-8298-a59026248b01"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:19:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-4de5edb6-9db9-4464-920e-d122a9833ddd req-b8c6fb29-3019-4c66-80e8-a97377932b90 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-4de5edb6-9db9-4464-920e-d122a9833ddd req-b8c6fb29-3019-4c66-80e8-a97377932b90 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-4de5edb6-9db9-4464-920e-d122a9833ddd req-b8c6fb29-3019-4c66-80e8-a97377932b90 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:02 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-4de5edb6-9db9-4464-920e-d122a9833ddd req-b8c6fb29-3019-4c66-80e8-a97377932b90 service nova] Creating event network-changed:b3a3698d-6a99-43ff-8298-a59026248b01 for instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 on user Apr 13 23:19:02 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-4de5edb6-9db9-4464-920e-d122a9833ddd req-b8c6fb29-3019-4c66-80e8-a97377932b90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032719 Apr 13 23:19:02 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 330/994] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:19:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:19:03 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-5fa1b197-288c-496f-a34f-832c46ca4a54 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:19:03 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-5fa1b197-288c-496f-a34f-832c46ca4a54 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:19:03 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:19:03 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=10 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:19:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5fa1b197-288c-496f-a34f-832c46ca4a54 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5fa1b197-288c-496f-a34f-832c46ca4a54 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5fa1b197-288c-496f-a34f-832c46ca4a54 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5fa1b197-288c-496f-a34f-832c46ca4a54 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5fa1b197-288c-496f-a34f-832c46ca4a54 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5fa1b197-288c-496f-a34f-832c46ca4a54 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:03 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-5fa1b197-288c-496f-a34f-832c46ca4a54 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/ips" status: 200 len: 108 microversion: 2.20 time: 0.038384 Apr 13 23:19:03 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 330/995] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 13 23:19:03 2023] GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/ips => generated 108 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 23:19:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:19:05 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:19:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:05 user devstack@n-api.service[61613]: DEBUG nova.objects.instance [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'flavor' on Instance uuid 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 {{(pid=61613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:19:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/action" status: 202 len: 0 microversion: 2.20 time: 0.737011 Apr 13 23:19:06 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 336/996] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 23:19:05 2023] POST /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/action => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:19:06 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-1176544e-e430-4408-9621-90db3fe19770 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:19:06 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-1176544e-e430-4408-9621-90db3fe19770 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:19:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1176544e-e430-4408-9621-90db3fe19770 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1176544e-e430-4408-9621-90db3fe19770 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1176544e-e430-4408-9621-90db3fe19770 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1176544e-e430-4408-9621-90db3fe19770 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1176544e-e430-4408-9621-90db3fe19770 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1176544e-e430-4408-9621-90db3fe19770 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:06 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-1176544e-e430-4408-9621-90db3fe19770 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:19:06 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-1176544e-e430-4408-9621-90db3fe19770 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:19:06 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-1176544e-e430-4408-9621-90db3fe19770 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:19:06 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-1176544e-e430-4408-9621-90db3fe19770 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" status: 200 len: 1708 microversion: 2.20 time: 0.223969 Apr 13 23:19:06 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 331/997] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:19:06 2023] GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 => generated 1708 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:19:06 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-42ec80e3-9a4c-4c59-a828-9d045b25879a req-437dcce6-f5cc-4dd0-8da1-ee011fdc130e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55", "name": "network-vif-unplugged", "status": "completed", "tag": "b3a3698d-6a99-43ff-8298-a59026248b01"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:19:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-42ec80e3-9a4c-4c59-a828-9d045b25879a req-437dcce6-f5cc-4dd0-8da1-ee011fdc130e service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-42ec80e3-9a4c-4c59-a828-9d045b25879a req-437dcce6-f5cc-4dd0-8da1-ee011fdc130e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-42ec80e3-9a4c-4c59-a828-9d045b25879a req-437dcce6-f5cc-4dd0-8da1-ee011fdc130e service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:06 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-42ec80e3-9a4c-4c59-a828-9d045b25879a req-437dcce6-f5cc-4dd0-8da1-ee011fdc130e service nova] Creating event network-vif-unplugged:b3a3698d-6a99-43ff-8298-a59026248b01 for instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 on user Apr 13 23:19:06 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-42ec80e3-9a4c-4c59-a828-9d045b25879a req-437dcce6-f5cc-4dd0-8da1-ee011fdc130e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033977 Apr 13 23:19:06 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 331/998] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:19:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:19:08 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-8ec462fd-5052-4075-9c6e-746fc9559e0f req-7840f415-2077-47c7-9719-7caf967de92d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55", "name": "network-vif-plugged", "status": "completed", "tag": "b3a3698d-6a99-43ff-8298-a59026248b01"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:19:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8ec462fd-5052-4075-9c6e-746fc9559e0f req-7840f415-2077-47c7-9719-7caf967de92d service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8ec462fd-5052-4075-9c6e-746fc9559e0f req-7840f415-2077-47c7-9719-7caf967de92d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8ec462fd-5052-4075-9c6e-746fc9559e0f req-7840f415-2077-47c7-9719-7caf967de92d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:08 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-8ec462fd-5052-4075-9c6e-746fc9559e0f req-7840f415-2077-47c7-9719-7caf967de92d service nova] Creating event network-vif-plugged:b3a3698d-6a99-43ff-8298-a59026248b01 for instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 on user Apr 13 23:19:08 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-8ec462fd-5052-4075-9c6e-746fc9559e0f req-7840f415-2077-47c7-9719-7caf967de92d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040076 Apr 13 23:19:08 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 337/999] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:19:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:19:11 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-89d48089-d288-44fa-91d4-5bb8c0297335 req-e72a9154-4282-4867-b8ea-66967b93cf29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55", "tag": "b3a3698d-6a99-43ff-8298-a59026248b01"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:19:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-89d48089-d288-44fa-91d4-5bb8c0297335 req-e72a9154-4282-4867-b8ea-66967b93cf29 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-89d48089-d288-44fa-91d4-5bb8c0297335 req-e72a9154-4282-4867-b8ea-66967b93cf29 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-89d48089-d288-44fa-91d4-5bb8c0297335 req-e72a9154-4282-4867-b8ea-66967b93cf29 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-89d48089-d288-44fa-91d4-5bb8c0297335 req-e72a9154-4282-4867-b8ea-66967b93cf29 service nova] Creating event network-changed:b3a3698d-6a99-43ff-8298-a59026248b01 for instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 on user Apr 13 23:19:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-89d48089-d288-44fa-91d4-5bb8c0297335 req-e72a9154-4282-4867-b8ea-66967b93cf29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.026988 Apr 13 23:19:11 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 332/1000] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:19:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:19:25 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:19:25 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:19:25 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-15f97a8b-a1c4-4965-8807-70fab1a49ee6 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:19:25 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-15f97a8b-a1c4-4965-8807-70fab1a49ee6 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:19:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-15f97a8b-a1c4-4965-8807-70fab1a49ee6 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-15f97a8b-a1c4-4965-8807-70fab1a49ee6 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-15f97a8b-a1c4-4965-8807-70fab1a49ee6 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-15f97a8b-a1c4-4965-8807-70fab1a49ee6 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-15f97a8b-a1c4-4965-8807-70fab1a49ee6 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-15f97a8b-a1c4-4965-8807-70fab1a49ee6 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:25 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-15f97a8b-a1c4-4965-8807-70fab1a49ee6 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17551363dd9f4e219ad7198b21509e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71645bbbfcc4e41994fe910043ca0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:19:25 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-15f97a8b-a1c4-4965-8807-70fab1a49ee6 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f" status: 200 len: 1538 microversion: 2.1 time: 0.180554 Apr 13 23:19:25 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 332/1001] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:19:25 2023] GET /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f => generated 1538 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:19:27 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-48b6742d-0b7a-4661-9cbc-02ef0f0cba05 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:19:27 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-48b6742d-0b7a-4661-9cbc-02ef0f0cba05 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:19:27 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:19:27 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:19:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-48b6742d-0b7a-4661-9cbc-02ef0f0cba05 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-48b6742d-0b7a-4661-9cbc-02ef0f0cba05 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-48b6742d-0b7a-4661-9cbc-02ef0f0cba05 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-48b6742d-0b7a-4661-9cbc-02ef0f0cba05 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-48b6742d-0b7a-4661-9cbc-02ef0f0cba05 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-48b6742d-0b7a-4661-9cbc-02ef0f0cba05 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:27 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-48b6742d-0b7a-4661-9cbc-02ef0f0cba05 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271839d0073b49689368301d420c588a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405da8dd69654b3fb74203d0b7e26ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:19:27 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-48b6742d-0b7a-4661-9cbc-02ef0f0cba05 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6" status: 200 len: 1432 microversion: 2.1 time: 0.169896 Apr 13 23:19:27 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 338/1002] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:19:27 2023] GET /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6 => generated 1432 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 23:19:50 user devstack@n-api.service[61611]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8b19f5bb-67a1-4de8-97cb-249b76327409] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 13 23:19:50 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:19:50 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=10 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:19:50 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-65341bd4-2423-4b42-9631-8e2ceb8a6f23 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:19:50 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-65341bd4-2423-4b42-9631-8e2ceb8a6f23 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:19:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-65341bd4-2423-4b42-9631-8e2ceb8a6f23 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-65341bd4-2423-4b42-9631-8e2ceb8a6f23 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-65341bd4-2423-4b42-9631-8e2ceb8a6f23 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-65341bd4-2423-4b42-9631-8e2ceb8a6f23 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-65341bd4-2423-4b42-9631-8e2ceb8a6f23 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-65341bd4-2423-4b42-9631-8e2ceb8a6f23 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:50 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-65341bd4-2423-4b42-9631-8e2ceb8a6f23 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:19:50 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-65341bd4-2423-4b42-9631-8e2ceb8a6f23 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1720 microversion: 2.1 time: 0.149043 Apr 13 23:19:50 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 333/1003] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:19:50 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:19:50 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:19:50 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:19:50 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-db121f23-9f7b-4db5-af19-47797dc53a82 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:19:50 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-db121f23-9f7b-4db5-af19-47797dc53a82 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:19:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-db121f23-9f7b-4db5-af19-47797dc53a82 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-db121f23-9f7b-4db5-af19-47797dc53a82 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-db121f23-9f7b-4db5-af19-47797dc53a82 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-db121f23-9f7b-4db5-af19-47797dc53a82 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-db121f23-9f7b-4db5-af19-47797dc53a82 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-db121f23-9f7b-4db5-af19-47797dc53a82 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:50 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-db121f23-9f7b-4db5-af19-47797dc53a82 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:19:50 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-db121f23-9f7b-4db5-af19-47797dc53a82 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1720 microversion: 2.1 time: 0.152977 Apr 13 23:19:50 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 333/1004] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:19:50 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 23:19:56 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-40e55c65-306c-4899-a911-373d8e085b2f tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:19:56 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-40e55c65-306c-4899-a911-373d8e085b2f tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:19:56 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:19:56 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:19:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-40e55c65-306c-4899-a911-373d8e085b2f tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-40e55c65-306c-4899-a911-373d8e085b2f tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-40e55c65-306c-4899-a911-373d8e085b2f tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-40e55c65-306c-4899-a911-373d8e085b2f tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:19:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-40e55c65-306c-4899-a911-373d8e085b2f tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:19:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-40e55c65-306c-4899-a911-373d8e085b2f tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:19:56 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-40e55c65-306c-4899-a911-373d8e085b2f tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:19:56 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-40e55c65-306c-4899-a911-373d8e085b2f tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:19:56 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-40e55c65-306c-4899-a911-373d8e085b2f tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:19:56 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-40e55c65-306c-4899-a911-373d8e085b2f tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" status: 200 len: 1649 microversion: 2.20 time: 0.155219 Apr 13 23:19:56 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 339/1005] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:19:56 2023] GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 => generated 1649 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 13 23:20:25 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:20:25 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:20:25 user devstack@n-api.service[61611]: INFO oslo.messaging._drivers.impl_rabbit [-] [8b19f5bb-67a1-4de8-97cb-249b76327409] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 50420. Apr 13 23:20:25 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-bfccc8f7-1817-43f0-8a27-2ff870183659 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:20:25 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-bfccc8f7-1817-43f0-8a27-2ff870183659 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:20:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bfccc8f7-1817-43f0-8a27-2ff870183659 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bfccc8f7-1817-43f0-8a27-2ff870183659 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bfccc8f7-1817-43f0-8a27-2ff870183659 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bfccc8f7-1817-43f0-8a27-2ff870183659 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bfccc8f7-1817-43f0-8a27-2ff870183659 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bfccc8f7-1817-43f0-8a27-2ff870183659 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:26 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-bfccc8f7-1817-43f0-8a27-2ff870183659 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17551363dd9f4e219ad7198b21509e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71645bbbfcc4e41994fe910043ca0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:20:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-bfccc8f7-1817-43f0-8a27-2ff870183659 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f" status: 200 len: 1538 microversion: 2.1 time: 0.221854 Apr 13 23:20:26 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 334/1006] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:20:25 2023] GET /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f => generated 1538 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:20:27 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:20:27 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:20:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-416eb36c-6543-4c6e-ab94-2be25f65091f req-2066fc0a-23c7-458b-bc24-4d46ea173491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06283ac1-5795-455d-9f85-38880202537f", "tag": "5fc574ab-be44-4634-ba3f-ac0faf630044"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:20:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-416eb36c-6543-4c6e-ab94-2be25f65091f req-2066fc0a-23c7-458b-bc24-4d46ea173491 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-416eb36c-6543-4c6e-ab94-2be25f65091f req-2066fc0a-23c7-458b-bc24-4d46ea173491 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-416eb36c-6543-4c6e-ab94-2be25f65091f req-2066fc0a-23c7-458b-bc24-4d46ea173491 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-416eb36c-6543-4c6e-ab94-2be25f65091f req-2066fc0a-23c7-458b-bc24-4d46ea173491 service nova] Creating event network-changed:5fc574ab-be44-4634-ba3f-ac0faf630044 for instance 06283ac1-5795-455d-9f85-38880202537f on user Apr 13 23:20:28 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-416eb36c-6543-4c6e-ab94-2be25f65091f req-2066fc0a-23c7-458b-bc24-4d46ea173491 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098553 Apr 13 23:20:28 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 334/1007] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:20:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:20:28 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:20:28 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:20:28 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-2a7a457d-d7f0-4b0e-83a7-d2fb2bd4f656 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:20:28 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-2a7a457d-d7f0-4b0e-83a7-d2fb2bd4f656 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:20:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2a7a457d-d7f0-4b0e-83a7-d2fb2bd4f656 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2a7a457d-d7f0-4b0e-83a7-d2fb2bd4f656 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2a7a457d-d7f0-4b0e-83a7-d2fb2bd4f656 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2a7a457d-d7f0-4b0e-83a7-d2fb2bd4f656 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2a7a457d-d7f0-4b0e-83a7-d2fb2bd4f656 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2a7a457d-d7f0-4b0e-83a7-d2fb2bd4f656 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:28 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7a742f2-f8c8-494d-82a6-51ed6c32e3fe"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:20:28 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:20:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:28 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-2a7a457d-d7f0-4b0e-83a7-d2fb2bd4f656 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271839d0073b49689368301d420c588a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405da8dd69654b3fb74203d0b7e26ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:20:28 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-2a7a457d-d7f0-4b0e-83a7-d2fb2bd4f656 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6" status: 200 len: 1432 microversion: 2.1 time: 0.202249 Apr 13 23:20:28 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 340/1008] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:20:28 2023] GET /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6 => generated 1432 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:20:28 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "POST /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315191 Apr 13 23:20:28 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 335/1009] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 23:20:28 2023] POST /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:20:29 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-6796c7c9-1fe8-438b-a888-c365a54e1304 req-1304ea3c-3e11-4d5e-99de-3dc13b6f711d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04eb8a55-c6d2-4a80-a818-060635d757a6", "tag": "60b18b3d-d206-49a4-81e4-f29a1b538a3c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:20:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6796c7c9-1fe8-438b-a888-c365a54e1304 req-1304ea3c-3e11-4d5e-99de-3dc13b6f711d service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6796c7c9-1fe8-438b-a888-c365a54e1304 req-1304ea3c-3e11-4d5e-99de-3dc13b6f711d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6796c7c9-1fe8-438b-a888-c365a54e1304 req-1304ea3c-3e11-4d5e-99de-3dc13b6f711d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:29 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-6796c7c9-1fe8-438b-a888-c365a54e1304 req-1304ea3c-3e11-4d5e-99de-3dc13b6f711d service nova] Creating event network-changed:60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance 04eb8a55-c6d2-4a80-a818-060635d757a6 on user Apr 13 23:20:29 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-6796c7c9-1fe8-438b-a888-c365a54e1304 req-1304ea3c-3e11-4d5e-99de-3dc13b6f711d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079594 Apr 13 23:20:29 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 335/1010] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:20:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:20:29 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:20:29 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:20:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:29 user devstack@n-api.service[61613]: DEBUG nova.objects.instance [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lazy-loading 'flavor' on Instance uuid 04eb8a55-c6d2-4a80-a818-060635d757a6 {{(pid=61613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:20:29 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] 10.0.0.210 "POST /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6/action" status: 202 len: 0 microversion: 2.1 time: 0.107015 Apr 13 23:20:29 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 341/1011] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 23:20:29 2023] POST /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:20:29 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-72810415-18d3-4da8-b097-0e58670603a1 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:20:29 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-72810415-18d3-4da8-b097-0e58670603a1 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:20:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-72810415-18d3-4da8-b097-0e58670603a1 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-72810415-18d3-4da8-b097-0e58670603a1 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-72810415-18d3-4da8-b097-0e58670603a1 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-72810415-18d3-4da8-b097-0e58670603a1 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-72810415-18d3-4da8-b097-0e58670603a1 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-72810415-18d3-4da8-b097-0e58670603a1 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:30 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-72810415-18d3-4da8-b097-0e58670603a1 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271839d0073b49689368301d420c588a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405da8dd69654b3fb74203d0b7e26ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:20:30 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-72810415-18d3-4da8-b097-0e58670603a1 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6" status: 200 len: 1438 microversion: 2.1 time: 0.262569 Apr 13 23:20:30 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 336/1012] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:20:29 2023] GET /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6 => generated 1438 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:20:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-9a030947-e88c-4060-a121-c153451707c7 req-06bef2e1-37d0-4fbe-a027-89cb16354e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04eb8a55-c6d2-4a80-a818-060635d757a6", "name": "network-vif-unplugged", "status": "completed", "tag": "60b18b3d-d206-49a4-81e4-f29a1b538a3c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:20:30 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-9a030947-e88c-4060-a121-c153451707c7 req-06bef2e1-37d0-4fbe-a027-89cb16354e16 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:30 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-9a030947-e88c-4060-a121-c153451707c7 req-06bef2e1-37d0-4fbe-a027-89cb16354e16 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:30 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-9a030947-e88c-4060-a121-c153451707c7 req-06bef2e1-37d0-4fbe-a027-89cb16354e16 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:30 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-9a030947-e88c-4060-a121-c153451707c7 req-06bef2e1-37d0-4fbe-a027-89cb16354e16 service nova] Creating event network-vif-unplugged:60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance 04eb8a55-c6d2-4a80-a818-060635d757a6 on user Apr 13 23:20:30 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-9a030947-e88c-4060-a121-c153451707c7 req-06bef2e1-37d0-4fbe-a027-89cb16354e16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032306 Apr 13 23:20:30 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 336/1013] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:20:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:20:32 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-4aa8c8c6-5c31-436b-83cc-f5fe0bb70ef7 req-8f02e5c3-88d2-4a21-b942-95509dfbbf0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04eb8a55-c6d2-4a80-a818-060635d757a6", "tag": "60b18b3d-d206-49a4-81e4-f29a1b538a3c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:20:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4aa8c8c6-5c31-436b-83cc-f5fe0bb70ef7 req-8f02e5c3-88d2-4a21-b942-95509dfbbf0a service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4aa8c8c6-5c31-436b-83cc-f5fe0bb70ef7 req-8f02e5c3-88d2-4a21-b942-95509dfbbf0a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4aa8c8c6-5c31-436b-83cc-f5fe0bb70ef7 req-8f02e5c3-88d2-4a21-b942-95509dfbbf0a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:32 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-4aa8c8c6-5c31-436b-83cc-f5fe0bb70ef7 req-8f02e5c3-88d2-4a21-b942-95509dfbbf0a service nova] Creating event network-changed:60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance 04eb8a55-c6d2-4a80-a818-060635d757a6 on user Apr 13 23:20:32 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-4aa8c8c6-5c31-436b-83cc-f5fe0bb70ef7 req-8f02e5c3-88d2-4a21-b942-95509dfbbf0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042386 Apr 13 23:20:32 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 342/1014] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:20:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 23:20:32 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-e46a5adf-bf38-4532-91e6-5242c1d1bfc1 req-a72b00ac-e21f-46a7-b7d9-f242209b286f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04eb8a55-c6d2-4a80-a818-060635d757a6", "name": "network-vif-plugged", "status": "completed", "tag": "60b18b3d-d206-49a4-81e4-f29a1b538a3c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:20:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-e46a5adf-bf38-4532-91e6-5242c1d1bfc1 req-a72b00ac-e21f-46a7-b7d9-f242209b286f service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-e46a5adf-bf38-4532-91e6-5242c1d1bfc1 req-a72b00ac-e21f-46a7-b7d9-f242209b286f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-e46a5adf-bf38-4532-91e6-5242c1d1bfc1 req-a72b00ac-e21f-46a7-b7d9-f242209b286f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:32 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-e46a5adf-bf38-4532-91e6-5242c1d1bfc1 req-a72b00ac-e21f-46a7-b7d9-f242209b286f service nova] Creating event network-vif-plugged:60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance 04eb8a55-c6d2-4a80-a818-060635d757a6 on user Apr 13 23:20:32 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-e46a5adf-bf38-4532-91e6-5242c1d1bfc1 req-a72b00ac-e21f-46a7-b7d9-f242209b286f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057221 Apr 13 23:20:32 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 337/1015] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:20:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:20:36 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:20:36 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:20:36 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:36 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:36 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:36 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:36 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:36 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:36 user devstack@n-api.service[61612]: DEBUG nova.objects.instance [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lazy-loading 'services' on Instance uuid 06283ac1-5795-455d-9f85-38880202537f {{(pid=61612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:20:36 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f/os-volume_attachments/a7a742f2-f8c8-494d-82a6-51ed6c32e3fe" status: 202 len: 0 microversion: 2.1 time: 0.188943 Apr 13 23:20:36 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 337/1016] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 23:20:36 2023] DELETE /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f/os-volume_attachments/a7a742f2-f8c8-494d-82a6-51ed6c32e3fe => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:20:36 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-fe3a628f-c901-4f65-b4aa-f0ea6bee3274 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:20:36 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-fe3a628f-c901-4f65-b4aa-f0ea6bee3274 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:20:36 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fe3a628f-c901-4f65-b4aa-f0ea6bee3274 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:36 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fe3a628f-c901-4f65-b4aa-f0ea6bee3274 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:36 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fe3a628f-c901-4f65-b4aa-f0ea6bee3274 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:36 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fe3a628f-c901-4f65-b4aa-f0ea6bee3274 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:36 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fe3a628f-c901-4f65-b4aa-f0ea6bee3274 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:36 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fe3a628f-c901-4f65-b4aa-f0ea6bee3274 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:36 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-fe3a628f-c901-4f65-b4aa-f0ea6bee3274 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079118 Apr 13 23:20:36 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 343/1017] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:20:36 2023] GET /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:20:50 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=8 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:20:50 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:20:50 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:20:50 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:20:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:50 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:50 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:20:50 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 204 len: 0 microversion: 2.1 time: 0.123506 Apr 13 23:20:50 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 338/1018] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:20:50 2023] DELETE /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:20:50 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=8 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:20:50 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:20:51 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-d5d329ad-73cb-4853-bdb6-1d3d62f1b635 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:20:51 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-d5d329ad-73cb-4853-bdb6-1d3d62f1b635 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:20:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d5d329ad-73cb-4853-bdb6-1d3d62f1b635 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d5d329ad-73cb-4853-bdb6-1d3d62f1b635 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d5d329ad-73cb-4853-bdb6-1d3d62f1b635 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d5d329ad-73cb-4853-bdb6-1d3d62f1b635 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d5d329ad-73cb-4853-bdb6-1d3d62f1b635 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d5d329ad-73cb-4853-bdb6-1d3d62f1b635 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:51 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-d5d329ad-73cb-4853-bdb6-1d3d62f1b635 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:20:51 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-d5d329ad-73cb-4853-bdb6-1d3d62f1b635 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 200 len: 1726 microversion: 2.1 time: 0.171166 Apr 13 23:20:51 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 338/1019] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:20:50 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:20:51 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-16d5f53e-3e9a-48fe-940a-a4a866b6ab99 req-de2eff57-b806-480e-9e37-f38dca9ee704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d", "name": "network-vif-unplugged", "status": "completed", "tag": "09cc0c17-bd49-4207-9de4-89178a1e681e"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:20:51 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=8 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:20:51 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:20:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-16d5f53e-3e9a-48fe-940a-a4a866b6ab99 req-de2eff57-b806-480e-9e37-f38dca9ee704 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-16d5f53e-3e9a-48fe-940a-a4a866b6ab99 req-de2eff57-b806-480e-9e37-f38dca9ee704 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:51 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-16d5f53e-3e9a-48fe-940a-a4a866b6ab99 req-de2eff57-b806-480e-9e37-f38dca9ee704 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:51 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-16d5f53e-3e9a-48fe-940a-a4a866b6ab99 req-de2eff57-b806-480e-9e37-f38dca9ee704 service nova] Creating event network-vif-unplugged:09cc0c17-bd49-4207-9de4-89178a1e681e for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d on user Apr 13 23:20:51 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-16d5f53e-3e9a-48fe-940a-a4a866b6ab99 req-de2eff57-b806-480e-9e37-f38dca9ee704 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061407 Apr 13 23:20:51 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 344/1020] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:20:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:20:52 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-e9a5e34d-1362-43df-9c63-a545107987f3 req-3da69b29-ade2-4f39-8aab-05c00fc97ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d", "name": "network-vif-deleted", "tag": "09cc0c17-bd49-4207-9de4-89178a1e681e"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:20:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-e9a5e34d-1362-43df-9c63-a545107987f3 req-3da69b29-ade2-4f39-8aab-05c00fc97ab7 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-e9a5e34d-1362-43df-9c63-a545107987f3 req-3da69b29-ade2-4f39-8aab-05c00fc97ab7 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-e9a5e34d-1362-43df-9c63-a545107987f3 req-3da69b29-ade2-4f39-8aab-05c00fc97ab7 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:52 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-e9a5e34d-1362-43df-9c63-a545107987f3 req-3da69b29-ade2-4f39-8aab-05c00fc97ab7 service nova] Creating event network-vif-deleted:09cc0c17-bd49-4207-9de4-89178a1e681e for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d on user Apr 13 23:20:52 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-e9a5e34d-1362-43df-9c63-a545107987f3 req-3da69b29-ade2-4f39-8aab-05c00fc97ab7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029294 Apr 13 23:20:52 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 339/1021] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:20:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:20:53 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-99c691bd-c0c1-4e8c-9678-cd720765cd16 req-93e03a1c-73c3-47e8-b127-81d9041d40e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d", "name": "network-vif-plugged", "status": "completed", "tag": "09cc0c17-bd49-4207-9de4-89178a1e681e"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:20:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-99c691bd-c0c1-4e8c-9678-cd720765cd16 req-93e03a1c-73c3-47e8-b127-81d9041d40e1 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-99c691bd-c0c1-4e8c-9678-cd720765cd16 req-93e03a1c-73c3-47e8-b127-81d9041d40e1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-99c691bd-c0c1-4e8c-9678-cd720765cd16 req-93e03a1c-73c3-47e8-b127-81d9041d40e1 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:53 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-99c691bd-c0c1-4e8c-9678-cd720765cd16 req-93e03a1c-73c3-47e8-b127-81d9041d40e1 service nova] Creating event network-vif-plugged:09cc0c17-bd49-4207-9de4-89178a1e681e for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d on user Apr 13 23:20:53 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-99c691bd-c0c1-4e8c-9678-cd720765cd16 req-93e03a1c-73c3-47e8-b127-81d9041d40e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030062 Apr 13 23:20:53 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 339/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:20:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:20:56 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5aa5102b-9aa9-4f89-b5d8-b2a97fdf122c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f353a28d-41ad-4994-b1ad-c46d03702c33"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:20:56 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-5aa5102b-9aa9-4f89-b5d8-b2a97fdf122c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:20:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5aa5102b-9aa9-4f89-b5d8-b2a97fdf122c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5aa5102b-9aa9-4f89-b5d8-b2a97fdf122c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5aa5102b-9aa9-4f89-b5d8-b2a97fdf122c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5aa5102b-9aa9-4f89-b5d8-b2a97fdf122c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5aa5102b-9aa9-4f89-b5d8-b2a97fdf122c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5aa5102b-9aa9-4f89-b5d8-b2a97fdf122c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:57 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-5aa5102b-9aa9-4f89-b5d8-b2a97fdf122c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.334512 Apr 13 23:20:57 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 345/1023] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 23:20:56 2023] POST /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/os-volume_attachments => generated 188 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 23:20:57 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:20:57 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:20:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:57 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61611) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 23:20:57 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/action" status: 202 len: 0 microversion: 2.20 time: 0.143583 Apr 13 23:20:57 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 340/1024] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 23:20:57 2023] POST /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:20:57 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-a843a1be-b025-4d6b-a520-eacd7c747efe tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:20:57 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-a843a1be-b025-4d6b-a520-eacd7c747efe tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:20:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a843a1be-b025-4d6b-a520-eacd7c747efe tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a843a1be-b025-4d6b-a520-eacd7c747efe tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a843a1be-b025-4d6b-a520-eacd7c747efe tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a843a1be-b025-4d6b-a520-eacd7c747efe tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:20:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a843a1be-b025-4d6b-a520-eacd7c747efe tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:20:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a843a1be-b025-4d6b-a520-eacd7c747efe tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:20:57 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-a843a1be-b025-4d6b-a520-eacd7c747efe tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:20:57 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-a843a1be-b025-4d6b-a520-eacd7c747efe tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:20:57 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-a843a1be-b025-4d6b-a520-eacd7c747efe tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:20:57 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-a843a1be-b025-4d6b-a520-eacd7c747efe tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" status: 200 len: 1735 microversion: 2.20 time: 0.163493 Apr 13 23:20:57 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 340/1025] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:20:57 2023] GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:21:03 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-4bf890d9-2efb-40a4-a9de-053d10bacf39 req-bd6ff97d-7455-48c0-a366-b309c8e40a86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55", "tag": "b3a3698d-6a99-43ff-8298-a59026248b01"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:21:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4bf890d9-2efb-40a4-a9de-053d10bacf39 req-bd6ff97d-7455-48c0-a366-b309c8e40a86 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4bf890d9-2efb-40a4-a9de-053d10bacf39 req-bd6ff97d-7455-48c0-a366-b309c8e40a86 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4bf890d9-2efb-40a4-a9de-053d10bacf39 req-bd6ff97d-7455-48c0-a366-b309c8e40a86 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:03 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-4bf890d9-2efb-40a4-a9de-053d10bacf39 req-bd6ff97d-7455-48c0-a366-b309c8e40a86 service nova] Creating event network-changed:b3a3698d-6a99-43ff-8298-a59026248b01 for instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 on user Apr 13 23:21:03 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-4bf890d9-2efb-40a4-a9de-053d10bacf39 req-bd6ff97d-7455-48c0-a366-b309c8e40a86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029849 Apr 13 23:21:03 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 346/1026] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:21:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:21:11 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:21:11 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:21:11 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-2a3499b7-618a-49c6-966d-e0cf29532ba3 req-0c45037d-eb8d-4a47-be45-4353427e4139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55", "name": "network-vif-plugged", "status": "completed", "tag": "b3a3698d-6a99-43ff-8298-a59026248b01"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:21:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-2a3499b7-618a-49c6-966d-e0cf29532ba3 req-0c45037d-eb8d-4a47-be45-4353427e4139 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-2a3499b7-618a-49c6-966d-e0cf29532ba3 req-0c45037d-eb8d-4a47-be45-4353427e4139 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-2a3499b7-618a-49c6-966d-e0cf29532ba3 req-0c45037d-eb8d-4a47-be45-4353427e4139 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-2a3499b7-618a-49c6-966d-e0cf29532ba3 req-0c45037d-eb8d-4a47-be45-4353427e4139 service nova] Creating event network-vif-plugged:b3a3698d-6a99-43ff-8298-a59026248b01 for instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 on user Apr 13 23:21:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-2a3499b7-618a-49c6-966d-e0cf29532ba3 req-0c45037d-eb8d-4a47-be45-4353427e4139 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093753 Apr 13 23:21:11 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 341/1027] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:21:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:21:13 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-85c87be4-4265-4fae-b438-25020f3293d8 req-aac2b3bd-e6db-47b8-ab05-15b885976531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55", "name": "network-vif-plugged", "status": "completed", "tag": "b3a3698d-6a99-43ff-8298-a59026248b01"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:21:13 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:21:13 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=14 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:21:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-85c87be4-4265-4fae-b438-25020f3293d8 req-aac2b3bd-e6db-47b8-ab05-15b885976531 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-85c87be4-4265-4fae-b438-25020f3293d8 req-aac2b3bd-e6db-47b8-ab05-15b885976531 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-85c87be4-4265-4fae-b438-25020f3293d8 req-aac2b3bd-e6db-47b8-ab05-15b885976531 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:13 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-85c87be4-4265-4fae-b438-25020f3293d8 req-aac2b3bd-e6db-47b8-ab05-15b885976531 service nova] Creating event network-vif-plugged:b3a3698d-6a99-43ff-8298-a59026248b01 for instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 on user Apr 13 23:21:13 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-85c87be4-4265-4fae-b438-25020f3293d8 req-aac2b3bd-e6db-47b8-ab05-15b885976531 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031545 Apr 13 23:21:13 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 341/1028] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:21:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:21:20 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:21:20 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:21:20 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-b523f1dc-6b4a-45f8-8506-836b0611b5b3 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:21:20 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-b523f1dc-6b4a-45f8-8506-836b0611b5b3 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:21:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b523f1dc-6b4a-45f8-8506-836b0611b5b3 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b523f1dc-6b4a-45f8-8506-836b0611b5b3 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b523f1dc-6b4a-45f8-8506-836b0611b5b3 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b523f1dc-6b4a-45f8-8506-836b0611b5b3 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b523f1dc-6b4a-45f8-8506-836b0611b5b3 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b523f1dc-6b4a-45f8-8506-836b0611b5b3 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:20 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-b523f1dc-6b4a-45f8-8506-836b0611b5b3 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271839d0073b49689368301d420c588a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405da8dd69654b3fb74203d0b7e26ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:21:20 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-b523f1dc-6b4a-45f8-8506-836b0611b5b3 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6" status: 200 len: 1497 microversion: 2.1 time: 0.188058 Apr 13 23:21:20 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 347/1029] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:21:20 2023] GET /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6 => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:21:26 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:21:26 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:21:26 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-a673ef03-a443-4e71-9eba-984f0f381871 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:21:26 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-a673ef03-a443-4e71-9eba-984f0f381871 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:21:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a673ef03-a443-4e71-9eba-984f0f381871 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a673ef03-a443-4e71-9eba-984f0f381871 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a673ef03-a443-4e71-9eba-984f0f381871 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a673ef03-a443-4e71-9eba-984f0f381871 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a673ef03-a443-4e71-9eba-984f0f381871 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a673ef03-a443-4e71-9eba-984f0f381871 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-a673ef03-a443-4e71-9eba-984f0f381871 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053700 Apr 13 23:21:26 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 342/1030] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:21:26 2023] GET /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 23:21:27 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:21:27 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:21:27 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-9c392f68-61d8-4197-8792-2353cbbf58ad req-2b0a041a-7ae5-478d-9069-bbcc410bfd8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06283ac1-5795-455d-9f85-38880202537f", "tag": "5fc574ab-be44-4634-ba3f-ac0faf630044"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:21:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:21:27 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:21:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-9c392f68-61d8-4197-8792-2353cbbf58ad req-2b0a041a-7ae5-478d-9069-bbcc410bfd8c service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-9c392f68-61d8-4197-8792-2353cbbf58ad req-2b0a041a-7ae5-478d-9069-bbcc410bfd8c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-9c392f68-61d8-4197-8792-2353cbbf58ad req-2b0a041a-7ae5-478d-9069-bbcc410bfd8c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:27 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-9c392f68-61d8-4197-8792-2353cbbf58ad req-2b0a041a-7ae5-478d-9069-bbcc410bfd8c service nova] Creating event network-changed:5fc574ab-be44-4634-ba3f-ac0faf630044 for instance 06283ac1-5795-455d-9f85-38880202537f on user Apr 13 23:21:27 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-9c392f68-61d8-4197-8792-2353cbbf58ad req-2b0a041a-7ae5-478d-9069-bbcc410bfd8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035959 Apr 13 23:21:27 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 348/1031] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:21:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:21:27 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Going to try to terminate instance {{(pid=61612) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:21:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f" status: 204 len: 0 microversion: 2.1 time: 0.131381 Apr 13 23:21:27 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 342/1032] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:21:27 2023] DELETE /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:21:27 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-abd5187e-ff7e-4088-b7cb-e12d0168e872 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:21:27 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-abd5187e-ff7e-4088-b7cb-e12d0168e872 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:21:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-abd5187e-ff7e-4088-b7cb-e12d0168e872 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-abd5187e-ff7e-4088-b7cb-e12d0168e872 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-abd5187e-ff7e-4088-b7cb-e12d0168e872 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-abd5187e-ff7e-4088-b7cb-e12d0168e872 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-abd5187e-ff7e-4088-b7cb-e12d0168e872 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-abd5187e-ff7e-4088-b7cb-e12d0168e872 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:27 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-abd5187e-ff7e-4088-b7cb-e12d0168e872 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17551363dd9f4e219ad7198b21509e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71645bbbfcc4e41994fe910043ca0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:21:27 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-abd5187e-ff7e-4088-b7cb-e12d0168e872 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f" status: 200 len: 1663 microversion: 2.1 time: 0.187158 Apr 13 23:21:27 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 343/1033] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:21:27 2023] GET /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f => generated 1663 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:21:29 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06283ac1-5795-455d-9f85-38880202537f", "name": "network-vif-unplugged", "status": "completed", "tag": "5fc574ab-be44-4634-ba3f-ac0faf630044"}, {"server_uuid": "06283ac1-5795-455d-9f85-38880202537f", "name": "network-vif-plugged", "status": "completed", "tag": "5fc574ab-be44-4634-ba3f-ac0faf630044"}, {"server_uuid": "06283ac1-5795-455d-9f85-38880202537f", "name": "network-vif-deleted", "tag": "5fc574ab-be44-4634-ba3f-ac0faf630044"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:21:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:29 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] Creating event network-vif-unplugged:5fc574ab-be44-4634-ba3f-ac0faf630044 for instance 06283ac1-5795-455d-9f85-38880202537f on user Apr 13 23:21:29 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] Creating event network-vif-plugged:5fc574ab-be44-4634-ba3f-ac0faf630044 for instance 06283ac1-5795-455d-9f85-38880202537f on user Apr 13 23:21:29 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] Creating event network-vif-deleted:5fc574ab-be44-4634-ba3f-ac0faf630044 for instance 06283ac1-5795-455d-9f85-38880202537f on user Apr 13 23:21:29 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.033471 Apr 13 23:21:29 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 349/1034] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:21:29 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:21:41 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-65fb9707-a319-4d35-a2e5-a86e0a83cc8a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:21:41 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-65fb9707-a319-4d35-a2e5-a86e0a83cc8a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:21:41 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:21:41 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:21:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-65fb9707-a319-4d35-a2e5-a86e0a83cc8a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-65fb9707-a319-4d35-a2e5-a86e0a83cc8a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-65fb9707-a319-4d35-a2e5-a86e0a83cc8a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-65fb9707-a319-4d35-a2e5-a86e0a83cc8a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-65fb9707-a319-4d35-a2e5-a86e0a83cc8a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-65fb9707-a319-4d35-a2e5-a86e0a83cc8a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:41 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-65fb9707-a319-4d35-a2e5-a86e0a83cc8a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] HTTP exception thrown: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:21:41 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-65fb9707-a319-4d35-a2e5-a86e0a83cc8a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Request method failure captured: Apr 13 23:21:41 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d HTTP/1.1 Apr 13 23:21:41 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:21:41 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:21:41 user devstack@n-api.service[61612]: Connection: close Apr 13 23:21:41 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:21:41 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:21:41 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:21:41 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:21:41 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:21:41 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIsprdmfAw_p4rozBbVwBT6Q-6RAJfFduOW0uBnZ9BZYwribtaPAynuD0u5SvQ-qSyV1qE9p-YGqiNKGPBfx4M0QkItrbmmlg5JeLj_f7yd_F1DQwSDmF4pVpShA4f3L3ELimyxWwQ2-JHK5pfZjQLSh6Xk-65WD5-EohxGIW2s73Ps Apr 13 23:21:41 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:21:41 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:21:41 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:21:41 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:21:41 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:21:41 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:21:41 user devstack@n-api.service[61612]: X-Project-Id: 68330047a5fd4e4397cf5edca18c5b51 Apr 13 23:21:41 user devstack@n-api.service[61612]: X-Project-Name: tempest-ServerActionsTestJSON-372556233 Apr 13 23:21:41 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:21:41 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:21:41 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:21:41 user devstack@n-api.service[61612]: X-Tenant: tempest-ServerActionsTestJSON-372556233 Apr 13 23:21:41 user devstack@n-api.service[61612]: X-Tenant-Id: 68330047a5fd4e4397cf5edca18c5b51 Apr 13 23:21:41 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-ServerActionsTestJSON-372556233 Apr 13 23:21:41 user devstack@n-api.service[61612]: X-User: tempest-ServerActionsTestJSON-372556233-project-member Apr 13 23:21:41 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:21:41 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:21:41 user devstack@n-api.service[61612]: X-User-Id: 59b2c11a23384f678a086de89139497d Apr 13 23:21:41 user devstack@n-api.service[61612]: X-User-Name: tempest-ServerActionsTestJSON-372556233-project-member Apr 13 23:21:41 user devstack@n-api.service[61612]: method: > Apr 13 23:21:41 user devstack@n-api.service[61612]: exception: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:21:41 user devstack@n-api.service[61612]: action_args: {'id': 'd3b4e1d5-1dce-4a64-8e09-68fadfe79a0d'} Apr 13 23:21:41 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:21:41 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:21:41 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-65fb9707-a319-4d35-a2e5-a86e0a83cc8a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Returning 404 to user: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:21:41 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-65fb9707-a319-4d35-a2e5-a86e0a83cc8a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 404 len: 111 microversion: 2.1 time: 0.038145 Apr 13 23:21:41 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 343/1035] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:21:41 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:21:41 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-efc34df7-0180-4035-902c-151d80ea386c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:21:41 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-efc34df7-0180-4035-902c-151d80ea386c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:21:41 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:21:41 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=12 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:21:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-efc34df7-0180-4035-902c-151d80ea386c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-efc34df7-0180-4035-902c-151d80ea386c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-efc34df7-0180-4035-902c-151d80ea386c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-efc34df7-0180-4035-902c-151d80ea386c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-efc34df7-0180-4035-902c-151d80ea386c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-efc34df7-0180-4035-902c-151d80ea386c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:41 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-efc34df7-0180-4035-902c-151d80ea386c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] HTTP exception thrown: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:21:41 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-efc34df7-0180-4035-902c-151d80ea386c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Request method failure captured: Apr 13 23:21:41 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/os-volume_attachments HTTP/1.1 Apr 13 23:21:41 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:21:41 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:21:41 user devstack@n-api.service[61611]: Connection: close Apr 13 23:21:41 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:21:41 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:21:41 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:21:41 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:21:41 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:21:41 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIsprdmfAw_p4rozBbVwBT6Q-6RAJfFduOW0uBnZ9BZYwribtaPAynuD0u5SvQ-qSyV1qE9p-YGqiNKGPBfx4M0QkItrbmmlg5JeLj_f7yd_F1DQwSDmF4pVpShA4f3L3ELimyxWwQ2-JHK5pfZjQLSh6Xk-65WD5-EohxGIW2s73Ps Apr 13 23:21:41 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:21:41 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:21:41 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:21:41 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:21:41 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:21:41 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:21:41 user devstack@n-api.service[61611]: X-Project-Id: 68330047a5fd4e4397cf5edca18c5b51 Apr 13 23:21:41 user devstack@n-api.service[61611]: X-Project-Name: tempest-ServerActionsTestJSON-372556233 Apr 13 23:21:41 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:21:41 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:21:41 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:21:41 user devstack@n-api.service[61611]: X-Tenant: tempest-ServerActionsTestJSON-372556233 Apr 13 23:21:41 user devstack@n-api.service[61611]: X-Tenant-Id: 68330047a5fd4e4397cf5edca18c5b51 Apr 13 23:21:41 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-ServerActionsTestJSON-372556233 Apr 13 23:21:41 user devstack@n-api.service[61611]: X-User: tempest-ServerActionsTestJSON-372556233-project-member Apr 13 23:21:41 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:21:41 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:21:41 user devstack@n-api.service[61611]: X-User-Id: 59b2c11a23384f678a086de89139497d Apr 13 23:21:41 user devstack@n-api.service[61611]: X-User-Name: tempest-ServerActionsTestJSON-372556233-project-member Apr 13 23:21:41 user devstack@n-api.service[61611]: method: > Apr 13 23:21:41 user devstack@n-api.service[61611]: exception: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:21:41 user devstack@n-api.service[61611]: action_args: {'server_id': 'd3b4e1d5-1dce-4a64-8e09-68fadfe79a0d'} Apr 13 23:21:41 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:21:41 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:21:41 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-efc34df7-0180-4035-902c-151d80ea386c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Returning 404 to user: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:21:41 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-efc34df7-0180-4035-902c-151d80ea386c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032334 Apr 13 23:21:41 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 344/1036] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 23:21:41 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:21:41 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:21:41 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=10 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:21:41 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e2c05ab4-d382-42b2-bcd6-285fe6b8383b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:21:41 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-e2c05ab4-d382-42b2-bcd6-285fe6b8383b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:21:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e2c05ab4-d382-42b2-bcd6-285fe6b8383b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e2c05ab4-d382-42b2-bcd6-285fe6b8383b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e2c05ab4-d382-42b2-bcd6-285fe6b8383b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e2c05ab4-d382-42b2-bcd6-285fe6b8383b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e2c05ab4-d382-42b2-bcd6-285fe6b8383b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e2c05ab4-d382-42b2-bcd6-285fe6b8383b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:41 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-e2c05ab4-d382-42b2-bcd6-285fe6b8383b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] HTTP exception thrown: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:21:41 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e2c05ab4-d382-42b2-bcd6-285fe6b8383b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Request method failure captured: Apr 13 23:21:41 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d HTTP/1.1 Apr 13 23:21:41 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:21:41 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:21:41 user devstack@n-api.service[61613]: Connection: close Apr 13 23:21:41 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:21:41 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:21:41 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:21:41 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:21:41 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:21:41 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIsprdmfAw_p4rozBbVwBT6Q-6RAJfFduOW0uBnZ9BZYwribtaPAynuD0u5SvQ-qSyV1qE9p-YGqiNKGPBfx4M0QkItrbmmlg5JeLj_f7yd_F1DQwSDmF4pVpShA4f3L3ELimyxWwQ2-JHK5pfZjQLSh6Xk-65WD5-EohxGIW2s73Ps Apr 13 23:21:41 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:21:41 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:21:41 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:21:41 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:21:41 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:21:41 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:21:41 user devstack@n-api.service[61613]: X-Project-Id: 68330047a5fd4e4397cf5edca18c5b51 Apr 13 23:21:41 user devstack@n-api.service[61613]: X-Project-Name: tempest-ServerActionsTestJSON-372556233 Apr 13 23:21:41 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:21:41 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:21:41 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:21:41 user devstack@n-api.service[61613]: X-Tenant: tempest-ServerActionsTestJSON-372556233 Apr 13 23:21:41 user devstack@n-api.service[61613]: X-Tenant-Id: 68330047a5fd4e4397cf5edca18c5b51 Apr 13 23:21:41 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-ServerActionsTestJSON-372556233 Apr 13 23:21:41 user devstack@n-api.service[61613]: X-User: tempest-ServerActionsTestJSON-372556233-project-member Apr 13 23:21:41 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:21:41 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:21:41 user devstack@n-api.service[61613]: X-User-Id: 59b2c11a23384f678a086de89139497d Apr 13 23:21:41 user devstack@n-api.service[61613]: X-User-Name: tempest-ServerActionsTestJSON-372556233-project-member Apr 13 23:21:41 user devstack@n-api.service[61613]: method: > Apr 13 23:21:41 user devstack@n-api.service[61613]: exception: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:21:41 user devstack@n-api.service[61613]: action_args: {'id': 'd3b4e1d5-1dce-4a64-8e09-68fadfe79a0d'} Apr 13 23:21:41 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:21:41 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:21:41 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e2c05ab4-d382-42b2-bcd6-285fe6b8383b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Returning 404 to user: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:21:41 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-e2c05ab4-d382-42b2-bcd6-285fe6b8383b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 404 len: 111 microversion: 2.1 time: 0.040543 Apr 13 23:21:41 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 350/1037] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:21:41 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:21:41 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-545240224", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "networks": [{"uuid": "85b04a3c-80c1-4d43-9e13-6f8de7286808"}], "security_groups": [{"name": "tempest-securitygroup--687542213"}], "key_name": "tempest-keypair-1382560979", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:21:41 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] validate_networks() for [('85b04a3c-80c1-4d43-9e13-6f8de7286808', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:21:42 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:21:42 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:21:42 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:21:42 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:21:42 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:21:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:42 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:42 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting quotas for project 68330047a5fd4e4397cf5edca18c5b51. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:21:42 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting quotas for user 59b2c11a23384f678a086de89139497d and project 68330047a5fd4e4397cf5edca18c5b51. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:21:42 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:21:42 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:21:42 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.545057 Apr 13 23:21:42 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 344/1038] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:21:41 2023] POST /compute/v2.1/servers => generated 403 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:21:42 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-3cde3f56-736a-473d-ae74-d07a30af768e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:21:42 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-3cde3f56-736a-473d-ae74-d07a30af768e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:21:42 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-3cde3f56-736a-473d-ae74-d07a30af768e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:21:42 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-3cde3f56-736a-473d-ae74-d07a30af768e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5af8749-cd19-4828-b6f6-e3628da12f01" status: 200 len: 1232 microversion: 2.1 time: 0.065629 Apr 13 23:21:42 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 345/1039] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:21:42 2023] GET /compute/v2.1/servers/b5af8749-cd19-4828-b6f6-e3628da12f01 => generated 1232 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:21:44 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-1a2cf5a2-fd6c-48cf-b7ef-aad4e2961914 req-3a72c1b8-d674-4a77-9c60-faef6d7d385b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5af8749-cd19-4828-b6f6-e3628da12f01", "tag": "1f5d0400-132c-4746-9b98-a86dfc3511af"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:21:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1a2cf5a2-fd6c-48cf-b7ef-aad4e2961914 req-3a72c1b8-d674-4a77-9c60-faef6d7d385b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1a2cf5a2-fd6c-48cf-b7ef-aad4e2961914 req-3a72c1b8-d674-4a77-9c60-faef6d7d385b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1a2cf5a2-fd6c-48cf-b7ef-aad4e2961914 req-3a72c1b8-d674-4a77-9c60-faef6d7d385b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:44 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-1a2cf5a2-fd6c-48cf-b7ef-aad4e2961914 req-3a72c1b8-d674-4a77-9c60-faef6d7d385b service nova] Creating event network-changed:1f5d0400-132c-4746-9b98-a86dfc3511af for instance b5af8749-cd19-4828-b6f6-e3628da12f01 on user Apr 13 23:21:44 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-1a2cf5a2-fd6c-48cf-b7ef-aad4e2961914 req-3a72c1b8-d674-4a77-9c60-faef6d7d385b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030114 Apr 13 23:21:44 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 351/1040] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:21:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:21:46 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-bafaa4e0-e9fb-4b16-b4c5-c81722588c53 req-9d86e5e0-6346-4ce6-9460-0ccde448a55b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5af8749-cd19-4828-b6f6-e3628da12f01", "name": "network-vif-plugged", "status": "completed", "tag": "1f5d0400-132c-4746-9b98-a86dfc3511af"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:21:46 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-bafaa4e0-e9fb-4b16-b4c5-c81722588c53 req-9d86e5e0-6346-4ce6-9460-0ccde448a55b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:46 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-bafaa4e0-e9fb-4b16-b4c5-c81722588c53 req-9d86e5e0-6346-4ce6-9460-0ccde448a55b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:46 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-bafaa4e0-e9fb-4b16-b4c5-c81722588c53 req-9d86e5e0-6346-4ce6-9460-0ccde448a55b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:46 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-bafaa4e0-e9fb-4b16-b4c5-c81722588c53 req-9d86e5e0-6346-4ce6-9460-0ccde448a55b service nova] Creating event network-vif-plugged:1f5d0400-132c-4746-9b98-a86dfc3511af for instance b5af8749-cd19-4828-b6f6-e3628da12f01 on user Apr 13 23:21:46 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-bafaa4e0-e9fb-4b16-b4c5-c81722588c53 req-9d86e5e0-6346-4ce6-9460-0ccde448a55b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032710 Apr 13 23:21:46 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 345/1041] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:21:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:21:47 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f1dee9e3-8bbc-4bd9-8b4c-a9d96745379c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:21:47 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f1dee9e3-8bbc-4bd9-8b4c-a9d96745379c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:21:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f1dee9e3-8bbc-4bd9-8b4c-a9d96745379c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f1dee9e3-8bbc-4bd9-8b4c-a9d96745379c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f1dee9e3-8bbc-4bd9-8b4c-a9d96745379c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f1dee9e3-8bbc-4bd9-8b4c-a9d96745379c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f1dee9e3-8bbc-4bd9-8b4c-a9d96745379c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f1dee9e3-8bbc-4bd9-8b4c-a9d96745379c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:47 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-f1dee9e3-8bbc-4bd9-8b4c-a9d96745379c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:21:47 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-f1dee9e3-8bbc-4bd9-8b4c-a9d96745379c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:21:47 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-f1dee9e3-8bbc-4bd9-8b4c-a9d96745379c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:21:47 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f1dee9e3-8bbc-4bd9-8b4c-a9d96745379c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" status: 200 len: 1780 microversion: 2.20 time: 0.146538 Apr 13 23:21:47 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 346/1042] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:21:47 2023] GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 => generated 1780 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:21:48 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-a3f22d19-bfb9-4442-bc6a-6600d89164ad req-52cf18df-6f76-41d5-b0be-440ec51e2862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5af8749-cd19-4828-b6f6-e3628da12f01", "name": "network-vif-plugged", "status": "completed", "tag": "1f5d0400-132c-4746-9b98-a86dfc3511af"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:21:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a3f22d19-bfb9-4442-bc6a-6600d89164ad req-52cf18df-6f76-41d5-b0be-440ec51e2862 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:21:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a3f22d19-bfb9-4442-bc6a-6600d89164ad req-52cf18df-6f76-41d5-b0be-440ec51e2862 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:21:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a3f22d19-bfb9-4442-bc6a-6600d89164ad req-52cf18df-6f76-41d5-b0be-440ec51e2862 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:21:48 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-a3f22d19-bfb9-4442-bc6a-6600d89164ad req-52cf18df-6f76-41d5-b0be-440ec51e2862 service nova] Creating event network-vif-plugged:1f5d0400-132c-4746-9b98-a86dfc3511af for instance b5af8749-cd19-4828-b6f6-e3628da12f01 on user Apr 13 23:21:48 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-a3f22d19-bfb9-4442-bc6a-6600d89164ad req-52cf18df-6f76-41d5-b0be-440ec51e2862 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040293 Apr 13 23:21:48 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 352/1043] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:21:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:22:17 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:22:17 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:22:17 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:22:17 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:22:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-78cc0bde-fafc-41e7-b428-58493a45783b tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:22:17 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-78cc0bde-fafc-41e7-b428-58493a45783b tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:22:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-78cc0bde-fafc-41e7-b428-58493a45783b tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-78cc0bde-fafc-41e7-b428-58493a45783b tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-78cc0bde-fafc-41e7-b428-58493a45783b tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-78cc0bde-fafc-41e7-b428-58493a45783b tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-78cc0bde-fafc-41e7-b428-58493a45783b tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-78cc0bde-fafc-41e7-b428-58493a45783b tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:17 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-78cc0bde-fafc-41e7-b428-58493a45783b tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] HTTP exception thrown: Instance 06283ac1-5795-455d-9f85-38880202537f could not be found. Apr 13 23:22:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-78cc0bde-fafc-41e7-b428-58493a45783b tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Request method failure captured: Apr 13 23:22:17 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f HTTP/1.1 Apr 13 23:22:17 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:22:17 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:22:17 user devstack@n-api.service[61612]: Connection: close Apr 13 23:22:17 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:22:17 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:22:17 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:22:17 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:22:17 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:22:17 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOI0Eb75V_qh-Zil6vH4sJvTQBZfioHzfWbZr2wq168t190cy7FHjEoqaxp8gS0b-iAHopM72FLUqh_lMGmyIR_6OwGNskJeZaBvaJCovINK1CJm-auaAr0nEBVOWBW9uQnuz3dkli4KWQdp-I-mXVto4CxhJNKJXnNbZBcJ8x5KA9kc Apr 13 23:22:17 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:22:17 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:22:17 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:22:17 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:22:17 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:22:17 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:22:17 user devstack@n-api.service[61612]: X-Project-Id: a71645bbbfcc4e41994fe910043ca0dd Apr 13 23:22:17 user devstack@n-api.service[61612]: X-Project-Name: tempest-TestStampPattern-1517924890 Apr 13 23:22:17 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:22:17 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:22:17 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a71645bbbfcc4e41994fe910043ca0dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a71645bbbfcc4e41994fe910043ca0dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a71645bbbfcc4e41994fe910043ca0dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:22:17 user devstack@n-api.service[61612]: X-Tenant: tempest-TestStampPattern-1517924890 Apr 13 23:22:17 user devstack@n-api.service[61612]: X-Tenant-Id: a71645bbbfcc4e41994fe910043ca0dd Apr 13 23:22:17 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-TestStampPattern-1517924890 Apr 13 23:22:17 user devstack@n-api.service[61612]: X-User: tempest-TestStampPattern-1517924890-project-member Apr 13 23:22:17 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:22:17 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:22:17 user devstack@n-api.service[61612]: X-User-Id: 17551363dd9f4e219ad7198b21509e48 Apr 13 23:22:17 user devstack@n-api.service[61612]: X-User-Name: tempest-TestStampPattern-1517924890-project-member Apr 13 23:22:17 user devstack@n-api.service[61612]: method: > Apr 13 23:22:17 user devstack@n-api.service[61612]: exception: Instance 06283ac1-5795-455d-9f85-38880202537f could not be found. Apr 13 23:22:17 user devstack@n-api.service[61612]: action_args: {'id': '06283ac1-5795-455d-9f85-38880202537f'} Apr 13 23:22:17 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06283ac1-5795-455d-9f85-38880202537f could not be found. Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06283ac1-5795-455d-9f85-38880202537f could not be found. Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06283ac1-5795-455d-9f85-38880202537f could not be found. Apr 13 23:22:17 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:22:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-78cc0bde-fafc-41e7-b428-58493a45783b tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Returning 404 to user: Instance 06283ac1-5795-455d-9f85-38880202537f could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:22:17 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-78cc0bde-fafc-41e7-b428-58493a45783b tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f" status: 404 len: 111 microversion: 2.1 time: 0.035785 Apr 13 23:22:17 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 346/1044] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:22:17 2023] GET /compute/v2.1/servers/06283ac1-5795-455d-9f85-38880202537f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:22:20 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:22:20 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:22:20 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:22:20 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=8 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:22:20 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=8 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:22:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:20 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61611) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 23:22:20 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] 10.0.0.210 "POST /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6/action" status: 202 len: 0 microversion: 2.1 time: 0.118118 Apr 13 23:22:20 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 347/1045] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 23:22:20 2023] POST /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:22:20 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-0b3329ad-2323-4386-824d-4df4841ad444 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:22:20 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-0b3329ad-2323-4386-824d-4df4841ad444 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:22:20 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:22:20 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:22:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0b3329ad-2323-4386-824d-4df4841ad444 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0b3329ad-2323-4386-824d-4df4841ad444 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0b3329ad-2323-4386-824d-4df4841ad444 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0b3329ad-2323-4386-824d-4df4841ad444 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0b3329ad-2323-4386-824d-4df4841ad444 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0b3329ad-2323-4386-824d-4df4841ad444 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:20 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-0b3329ad-2323-4386-824d-4df4841ad444 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271839d0073b49689368301d420c588a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405da8dd69654b3fb74203d0b7e26ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:22:20 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-0b3329ad-2323-4386-824d-4df4841ad444 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6" status: 200 len: 1505 microversion: 2.1 time: 0.189594 Apr 13 23:22:20 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 353/1046] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:22:20 2023] GET /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6 => generated 1505 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:22:22 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-4316c545-fa52-4a87-9e8f-759541c3e53c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:22:22 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-4316c545-fa52-4a87-9e8f-759541c3e53c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:22:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4316c545-fa52-4a87-9e8f-759541c3e53c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4316c545-fa52-4a87-9e8f-759541c3e53c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4316c545-fa52-4a87-9e8f-759541c3e53c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4316c545-fa52-4a87-9e8f-759541c3e53c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4316c545-fa52-4a87-9e8f-759541c3e53c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4316c545-fa52-4a87-9e8f-759541c3e53c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:22 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-4316c545-fa52-4a87-9e8f-759541c3e53c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] HTTP exception thrown: Instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 is not attached to volume b781e478-ccad-4879-a98b-59c42a5c8b70 Apr 13 23:22:22 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-4316c545-fa52-4a87-9e8f-759541c3e53c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Request method failure captured: Apr 13 23:22:22 user devstack@n-api.service[61612]: request: DELETE /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/os-volume_attachments/b781e478-ccad-4879-a98b-59c42a5c8b70 HTTP/1.1 Apr 13 23:22:22 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:22:22 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:22:22 user devstack@n-api.service[61612]: Connection: close Apr 13 23:22:22 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:22:22 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:22:22 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:22:22 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:22:22 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:22:22 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOI0Eb75V_qh-Zil6vH4sJvTQBZfioHzfWbZr2wq168t190cy7FHjEoqaxp8gS0b-iAHopM72FLUqh_lMGmyIR_6OwGNskJeZaBvaJCovINK1CJm-auaAr0nEBVOWBW9uQnuz3dkli4KWQdp-I-mXVto4CxhJNKJXnNbZBcJ8x5KA9kc Apr 13 23:22:22 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:22:22 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:22:22 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:22:22 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:22:22 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:22:22 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:22:22 user devstack@n-api.service[61612]: X-Project-Id: a71645bbbfcc4e41994fe910043ca0dd Apr 13 23:22:22 user devstack@n-api.service[61612]: X-Project-Name: tempest-TestStampPattern-1517924890 Apr 13 23:22:22 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:22:22 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:22:22 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a71645bbbfcc4e41994fe910043ca0dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a71645bbbfcc4e41994fe910043ca0dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a71645bbbfcc4e41994fe910043ca0dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:22:22 user devstack@n-api.service[61612]: X-Tenant: tempest-TestStampPattern-1517924890 Apr 13 23:22:22 user devstack@n-api.service[61612]: X-Tenant-Id: a71645bbbfcc4e41994fe910043ca0dd Apr 13 23:22:22 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-TestStampPattern-1517924890 Apr 13 23:22:22 user devstack@n-api.service[61612]: X-User: tempest-TestStampPattern-1517924890-project-member Apr 13 23:22:22 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:22:22 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:22:22 user devstack@n-api.service[61612]: X-User-Id: 17551363dd9f4e219ad7198b21509e48 Apr 13 23:22:22 user devstack@n-api.service[61612]: X-User-Name: tempest-TestStampPattern-1517924890-project-member Apr 13 23:22:22 user devstack@n-api.service[61612]: method: > Apr 13 23:22:22 user devstack@n-api.service[61612]: exception: Instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 is not attached to volume b781e478-ccad-4879-a98b-59c42a5c8b70 Apr 13 23:22:22 user devstack@n-api.service[61612]: action_args: {'server_id': 'f522c0be-7d51-421c-8d6c-d01ce6f6eb26', 'id': 'b781e478-ccad-4879-a98b-59c42a5c8b70'} Apr 13 23:22:22 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b781e478-ccad-4879-a98b-59c42a5c8b70. Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 is not attached to volume b781e478-ccad-4879-a98b-59c42a5c8b70 Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 is not attached to volume b781e478-ccad-4879-a98b-59c42a5c8b70 Apr 13 23:22:22 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:22:22 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-4316c545-fa52-4a87-9e8f-759541c3e53c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Returning 404 to user: Instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 is not attached to volume b781e478-ccad-4879-a98b-59c42a5c8b70 {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:22:22 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-4316c545-fa52-4a87-9e8f-759541c3e53c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/os-volume_attachments/b781e478-ccad-4879-a98b-59c42a5c8b70" status: 404 len: 154 microversion: 2.1 time: 0.088670 Apr 13 23:22:22 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 347/1047] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 23:22:22 2023] DELETE /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/os-volume_attachments/b781e478-ccad-4879-a98b-59c42a5c8b70 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:22:22 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:22:22 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:22:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:22 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-743d6355-0318-4aa3-a2eb-752faa301551 req-7287bd35-a88c-4238-bdd3-29be303052f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f522c0be-7d51-421c-8d6c-d01ce6f6eb26", "tag": "319f1294-7d2b-4725-8ecd-a21ef3df06e8"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:22:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:22 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-743d6355-0318-4aa3-a2eb-752faa301551 req-7287bd35-a88c-4238-bdd3-29be303052f9 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-743d6355-0318-4aa3-a2eb-752faa301551 req-7287bd35-a88c-4238-bdd3-29be303052f9 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-743d6355-0318-4aa3-a2eb-752faa301551 req-7287bd35-a88c-4238-bdd3-29be303052f9 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-743d6355-0318-4aa3-a2eb-752faa301551 req-7287bd35-a88c-4238-bdd3-29be303052f9 service nova] Creating event network-changed:319f1294-7d2b-4725-8ecd-a21ef3df06e8 for instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 on user Apr 13 23:22:22 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:22:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-743d6355-0318-4aa3-a2eb-752faa301551 req-7287bd35-a88c-4238-bdd3-29be303052f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038159 Apr 13 23:22:22 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 354/1048] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:22:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:22:23 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26" status: 204 len: 0 microversion: 2.1 time: 0.151312 Apr 13 23:22:23 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 348/1049] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:22:22 2023] DELETE /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 13 23:22:23 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-1109ee6f-73c2-4dbd-a4ed-d0ef1aa4841c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:22:23 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-1109ee6f-73c2-4dbd-a4ed-d0ef1aa4841c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:22:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1109ee6f-73c2-4dbd-a4ed-d0ef1aa4841c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1109ee6f-73c2-4dbd-a4ed-d0ef1aa4841c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1109ee6f-73c2-4dbd-a4ed-d0ef1aa4841c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1109ee6f-73c2-4dbd-a4ed-d0ef1aa4841c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1109ee6f-73c2-4dbd-a4ed-d0ef1aa4841c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1109ee6f-73c2-4dbd-a4ed-d0ef1aa4841c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:23 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-1109ee6f-73c2-4dbd-a4ed-d0ef1aa4841c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17551363dd9f4e219ad7198b21509e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71645bbbfcc4e41994fe910043ca0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:22:23 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-1109ee6f-73c2-4dbd-a4ed-d0ef1aa4841c tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26" status: 200 len: 1662 microversion: 2.1 time: 0.318796 Apr 13 23:22:23 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 348/1050] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:22:23 2023] GET /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26 => generated 1662 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:22:24 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f522c0be-7d51-421c-8d6c-d01ce6f6eb26", "name": "network-vif-unplugged", "status": "completed", "tag": "319f1294-7d2b-4725-8ecd-a21ef3df06e8"}, {"server_uuid": "f522c0be-7d51-421c-8d6c-d01ce6f6eb26", "name": "network-vif-plugged", "status": "completed", "tag": "319f1294-7d2b-4725-8ecd-a21ef3df06e8"}, {"server_uuid": "f522c0be-7d51-421c-8d6c-d01ce6f6eb26", "name": "network-vif-deleted", "tag": "319f1294-7d2b-4725-8ecd-a21ef3df06e8"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:22:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:24 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] Creating event network-vif-unplugged:319f1294-7d2b-4725-8ecd-a21ef3df06e8 for instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 on user Apr 13 23:22:24 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] Creating event network-vif-plugged:319f1294-7d2b-4725-8ecd-a21ef3df06e8 for instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 on user Apr 13 23:22:24 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] Creating event network-vif-deleted:319f1294-7d2b-4725-8ecd-a21ef3df06e8 for instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 on user Apr 13 23:22:24 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.034419 Apr 13 23:22:24 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 355/1051] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:22:24 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:22:27 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-44469045-66a8-4797-bf4c-c1ee6669e2bb req-2f7c19b5-7b0b-4693-807f-e4dc30528b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04eb8a55-c6d2-4a80-a818-060635d757a6", "tag": "60b18b3d-d206-49a4-81e4-f29a1b538a3c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:22:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-44469045-66a8-4797-bf4c-c1ee6669e2bb req-2f7c19b5-7b0b-4693-807f-e4dc30528b5a service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-44469045-66a8-4797-bf4c-c1ee6669e2bb req-2f7c19b5-7b0b-4693-807f-e4dc30528b5a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-44469045-66a8-4797-bf4c-c1ee6669e2bb req-2f7c19b5-7b0b-4693-807f-e4dc30528b5a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:27 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-44469045-66a8-4797-bf4c-c1ee6669e2bb req-2f7c19b5-7b0b-4693-807f-e4dc30528b5a service nova] Creating event network-changed:60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance 04eb8a55-c6d2-4a80-a818-060635d757a6 on user Apr 13 23:22:27 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-44469045-66a8-4797-bf4c-c1ee6669e2bb req-2f7c19b5-7b0b-4693-807f-e4dc30528b5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029810 Apr 13 23:22:27 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 349/1052] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:22:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:22:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-6e5f28a5-9585-425d-8524-988be4b66e88 req-83410bc8-9572-481c-bc8d-dd2f21c4e0b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04eb8a55-c6d2-4a80-a818-060635d757a6", "name": "network-vif-plugged", "status": "completed", "tag": "60b18b3d-d206-49a4-81e4-f29a1b538a3c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:22:30 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6e5f28a5-9585-425d-8524-988be4b66e88 req-83410bc8-9572-481c-bc8d-dd2f21c4e0b2 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:30 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6e5f28a5-9585-425d-8524-988be4b66e88 req-83410bc8-9572-481c-bc8d-dd2f21c4e0b2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:30 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6e5f28a5-9585-425d-8524-988be4b66e88 req-83410bc8-9572-481c-bc8d-dd2f21c4e0b2 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:30 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-6e5f28a5-9585-425d-8524-988be4b66e88 req-83410bc8-9572-481c-bc8d-dd2f21c4e0b2 service nova] Creating event network-vif-plugged:60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance 04eb8a55-c6d2-4a80-a818-060635d757a6 on user Apr 13 23:22:30 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-6e5f28a5-9585-425d-8524-988be4b66e88 req-83410bc8-9572-481c-bc8d-dd2f21c4e0b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046381 Apr 13 23:22:30 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 349/1053] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:22:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:22:32 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-6abbc3d8-f500-4635-b0fb-1913e8753abb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:22:32 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-6abbc3d8-f500-4635-b0fb-1913e8753abb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:22:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6abbc3d8-f500-4635-b0fb-1913e8753abb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6abbc3d8-f500-4635-b0fb-1913e8753abb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6abbc3d8-f500-4635-b0fb-1913e8753abb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6abbc3d8-f500-4635-b0fb-1913e8753abb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6abbc3d8-f500-4635-b0fb-1913e8753abb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6abbc3d8-f500-4635-b0fb-1913e8753abb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:32 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-32403627-01b6-4c99-bf12-1d7fef1f575f req-3d8c4320-f3d1-4a1d-9afa-19b0afcecc33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04eb8a55-c6d2-4a80-a818-060635d757a6", "name": "network-vif-plugged", "status": "completed", "tag": "60b18b3d-d206-49a4-81e4-f29a1b538a3c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:22:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-32403627-01b6-4c99-bf12-1d7fef1f575f req-3d8c4320-f3d1-4a1d-9afa-19b0afcecc33 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-32403627-01b6-4c99-bf12-1d7fef1f575f req-3d8c4320-f3d1-4a1d-9afa-19b0afcecc33 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-32403627-01b6-4c99-bf12-1d7fef1f575f req-3d8c4320-f3d1-4a1d-9afa-19b0afcecc33 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:32 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-6abbc3d8-f500-4635-b0fb-1913e8753abb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:22:32 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-6abbc3d8-f500-4635-b0fb-1913e8753abb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5af8749-cd19-4828-b6f6-e3628da12f01" status: 200 len: 1538 microversion: 2.1 time: 0.284361 Apr 13 23:22:32 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 356/1054] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:22:32 2023] GET /compute/v2.1/servers/b5af8749-cd19-4828-b6f6-e3628da12f01 => generated 1538 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:22:32 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-32403627-01b6-4c99-bf12-1d7fef1f575f req-3d8c4320-f3d1-4a1d-9afa-19b0afcecc33 service nova] Creating event network-vif-plugged:60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance 04eb8a55-c6d2-4a80-a818-060635d757a6 on user Apr 13 23:22:32 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-32403627-01b6-4c99-bf12-1d7fef1f575f req-3d8c4320-f3d1-4a1d-9afa-19b0afcecc33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058270 Apr 13 23:22:32 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 350/1055] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:22:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:22:47 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=8 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:22:47 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=16 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:22:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-818fa2cd-d492-4b12-94cf-dc0269757fe2 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:22:48 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-818fa2cd-d492-4b12-94cf-dc0269757fe2 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:22:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-818fa2cd-d492-4b12-94cf-dc0269757fe2 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-818fa2cd-d492-4b12-94cf-dc0269757fe2 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-818fa2cd-d492-4b12-94cf-dc0269757fe2 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-818fa2cd-d492-4b12-94cf-dc0269757fe2 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-818fa2cd-d492-4b12-94cf-dc0269757fe2 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-818fa2cd-d492-4b12-94cf-dc0269757fe2 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-818fa2cd-d492-4b12-94cf-dc0269757fe2 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/os-volume_attachments/f353a28d-41ad-4994-b1ad-c46d03702c33" status: 200 len: 194 microversion: 2.20 time: 0.163147 Apr 13 23:22:48 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 350/1056] 10.0.0.210 () {64 vars in 1531 bytes} [Thu Apr 13 23:22:47 2023] GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/os-volume_attachments/f353a28d-41ad-4994-b1ad-c46d03702c33 => generated 194 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 23:22:48 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:22:48 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:22:48 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=8 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:22:48 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=16 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:22:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:48 user devstack@n-api.service[61613]: DEBUG nova.objects.instance [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'services' on Instance uuid 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 {{(pid=61613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:22:48 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/os-volume_attachments/f353a28d-41ad-4994-b1ad-c46d03702c33" status: 202 len: 0 microversion: 2.20 time: 0.175235 Apr 13 23:22:48 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 357/1057] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 23:22:48 2023] DELETE /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/os-volume_attachments/f353a28d-41ad-4994-b1ad-c46d03702c33 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:22:48 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:22:48 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:22:48 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-72e358da-e154-4b2c-9093-a7c5f730147c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:22:48 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-72e358da-e154-4b2c-9093-a7c5f730147c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:22:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-72e358da-e154-4b2c-9093-a7c5f730147c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-72e358da-e154-4b2c-9093-a7c5f730147c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-72e358da-e154-4b2c-9093-a7c5f730147c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-72e358da-e154-4b2c-9093-a7c5f730147c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:22:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-72e358da-e154-4b2c-9093-a7c5f730147c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:22:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-72e358da-e154-4b2c-9093-a7c5f730147c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:22:48 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-72e358da-e154-4b2c-9093-a7c5f730147c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051826 Apr 13 23:22:48 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 351/1058] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 23:22:48 2023] GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 23:23:10 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-a9efa9f2-87d5-42c1-a870-5395117bd5f9 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:23:10 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-a9efa9f2-87d5-42c1-a870-5395117bd5f9 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:23:10 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:23:10 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:23:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a9efa9f2-87d5-42c1-a870-5395117bd5f9 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a9efa9f2-87d5-42c1-a870-5395117bd5f9 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a9efa9f2-87d5-42c1-a870-5395117bd5f9 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a9efa9f2-87d5-42c1-a870-5395117bd5f9 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a9efa9f2-87d5-42c1-a870-5395117bd5f9 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a9efa9f2-87d5-42c1-a870-5395117bd5f9 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:11 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-a9efa9f2-87d5-42c1-a870-5395117bd5f9 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271839d0073b49689368301d420c588a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405da8dd69654b3fb74203d0b7e26ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:23:11 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-a9efa9f2-87d5-42c1-a870-5395117bd5f9 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6" status: 200 len: 1550 microversion: 2.1 time: 0.162315 Apr 13 23:23:11 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 351/1059] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:23:10 2023] GET /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6 => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:23:13 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:23:13 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:23:13 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-770fa466-e71b-4d08-a4d3-f6e165b1dbd1 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:23:13 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-770fa466-e71b-4d08-a4d3-f6e165b1dbd1 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:23:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-770fa466-e71b-4d08-a4d3-f6e165b1dbd1 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-770fa466-e71b-4d08-a4d3-f6e165b1dbd1 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-770fa466-e71b-4d08-a4d3-f6e165b1dbd1 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-770fa466-e71b-4d08-a4d3-f6e165b1dbd1 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-770fa466-e71b-4d08-a4d3-f6e165b1dbd1 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-770fa466-e71b-4d08-a4d3-f6e165b1dbd1 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:13 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-770fa466-e71b-4d08-a4d3-f6e165b1dbd1 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] HTTP exception thrown: Instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 could not be found. Apr 13 23:23:13 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-770fa466-e71b-4d08-a4d3-f6e165b1dbd1 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Request method failure captured: Apr 13 23:23:13 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26 HTTP/1.1 Apr 13 23:23:13 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:23:13 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:23:13 user devstack@n-api.service[61613]: Connection: close Apr 13 23:23:13 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:23:13 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:23:13 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:23:13 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:23:13 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:23:13 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOI0Eb75V_qh-Zil6vH4sJvTQBZfioHzfWbZr2wq168t190cy7FHjEoqaxp8gS0b-iAHopM72FLUqh_lMGmyIR_6OwGNskJeZaBvaJCovINK1CJm-auaAr0nEBVOWBW9uQnuz3dkli4KWQdp-I-mXVto4CxhJNKJXnNbZBcJ8x5KA9kc Apr 13 23:23:13 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:23:13 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:23:13 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:23:13 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:23:13 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:23:13 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:23:13 user devstack@n-api.service[61613]: X-Project-Id: a71645bbbfcc4e41994fe910043ca0dd Apr 13 23:23:13 user devstack@n-api.service[61613]: X-Project-Name: tempest-TestStampPattern-1517924890 Apr 13 23:23:13 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:23:13 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:23:13 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a71645bbbfcc4e41994fe910043ca0dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a71645bbbfcc4e41994fe910043ca0dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a71645bbbfcc4e41994fe910043ca0dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:23:13 user devstack@n-api.service[61613]: X-Tenant: tempest-TestStampPattern-1517924890 Apr 13 23:23:13 user devstack@n-api.service[61613]: X-Tenant-Id: a71645bbbfcc4e41994fe910043ca0dd Apr 13 23:23:13 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-TestStampPattern-1517924890 Apr 13 23:23:13 user devstack@n-api.service[61613]: X-User: tempest-TestStampPattern-1517924890-project-member Apr 13 23:23:13 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:23:13 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:23:13 user devstack@n-api.service[61613]: X-User-Id: 17551363dd9f4e219ad7198b21509e48 Apr 13 23:23:13 user devstack@n-api.service[61613]: X-User-Name: tempest-TestStampPattern-1517924890-project-member Apr 13 23:23:13 user devstack@n-api.service[61613]: method: > Apr 13 23:23:13 user devstack@n-api.service[61613]: exception: Instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 could not be found. Apr 13 23:23:13 user devstack@n-api.service[61613]: action_args: {'id': 'f522c0be-7d51-421c-8d6c-d01ce6f6eb26'} Apr 13 23:23:13 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 could not be found. Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 could not be found. Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 could not be found. Apr 13 23:23:13 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:23:13 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-770fa466-e71b-4d08-a4d3-f6e165b1dbd1 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Returning 404 to user: Instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:23:13 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-770fa466-e71b-4d08-a4d3-f6e165b1dbd1 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26" status: 404 len: 111 microversion: 2.1 time: 0.039785 Apr 13 23:23:13 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 358/1060] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:23:13 2023] GET /compute/v2.1/servers/f522c0be-7d51-421c-8d6c-d01ce6f6eb26 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:23:17 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-991030db-db2f-49d9-98fd-30a3c252cd7f tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Calling method '.version_select at 0x7f3d1c505e10>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:23:17 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:23:17 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:23:17 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-991030db-db2f-49d9-98fd-30a3c252cd7f tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-668013808" status: 202 len: 0 microversion: 2.1 time: 0.036278 Apr 13 23:23:17 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 352/1061] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 23:23:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-668013808 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:23:32 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:23:32 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:23:32 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-686b89b7-a23b-4ab5-8ce5-6fb895d80ac5 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:23:32 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-686b89b7-a23b-4ab5-8ce5-6fb895d80ac5 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:23:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-686b89b7-a23b-4ab5-8ce5-6fb895d80ac5 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-686b89b7-a23b-4ab5-8ce5-6fb895d80ac5 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-686b89b7-a23b-4ab5-8ce5-6fb895d80ac5 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-686b89b7-a23b-4ab5-8ce5-6fb895d80ac5 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-686b89b7-a23b-4ab5-8ce5-6fb895d80ac5 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:32 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-686b89b7-a23b-4ab5-8ce5-6fb895d80ac5 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:33 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-686b89b7-a23b-4ab5-8ce5-6fb895d80ac5 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5af8749-cd19-4828-b6f6-e3628da12f01/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.431406 Apr 13 23:23:33 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 352/1062] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 23:23:32 2023] GET /compute/v2.1/servers/b5af8749-cd19-4828-b6f6-e3628da12f01/os-interface => generated 282 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:23:33 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-b70e235e-43ae-4515-a553-3c784d531eba req-b7c786b2-b14d-4474-9254-7c0156858029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5af8749-cd19-4828-b6f6-e3628da12f01", "tag": "1f5d0400-132c-4746-9b98-a86dfc3511af"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:23:34 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:23:34 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:23:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-b70e235e-43ae-4515-a553-3c784d531eba req-b7c786b2-b14d-4474-9254-7c0156858029 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-b70e235e-43ae-4515-a553-3c784d531eba req-b7c786b2-b14d-4474-9254-7c0156858029 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-b70e235e-43ae-4515-a553-3c784d531eba req-b7c786b2-b14d-4474-9254-7c0156858029 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:34 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-b70e235e-43ae-4515-a553-3c784d531eba req-b7c786b2-b14d-4474-9254-7c0156858029 service nova] Creating event network-changed:1f5d0400-132c-4746-9b98-a86dfc3511af for instance b5af8749-cd19-4828-b6f6-e3628da12f01 on user Apr 13 23:23:34 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-b70e235e-43ae-4515-a553-3c784d531eba req-b7c786b2-b14d-4474-9254-7c0156858029 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052989 Apr 13 23:23:34 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 359/1063] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:23:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:23:36 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:23:36 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1208753564", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "85b04a3c-80c1-4d43-9e13-6f8de7286808"}], "security_groups": [{"name": "tempest-securitygroup--687542213"}], "key_name": "tempest-keypair-1382560979", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "78d07dc5-246c-4db0-a870-2beebf4310a9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:23:36 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] validate_networks() for [('85b04a3c-80c1-4d43-9e13-6f8de7286808', None, None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:23:37 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:23:37 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:23:37 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:23:37 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:23:37 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:23:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:37 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting quotas for project 68330047a5fd4e4397cf5edca18c5b51. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:23:37 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting quotas for user 59b2c11a23384f678a086de89139497d and project 68330047a5fd4e4397cf5edca18c5b51. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:23:37 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:23:37 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='78d07dc5-246c-4db0-a870-2beebf4310a9',volume_size=None,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:23:37 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.967993 Apr 13 23:23:37 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 353/1064] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 23:23:36 2023] POST /compute/v2.1/servers => generated 403 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 23:23:37 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-3be94991-a517-4958-823b-1e3d2e17423b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:23:37 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-3be94991-a517-4958-823b-1e3d2e17423b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:23:37 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-3be94991-a517-4958-823b-1e3d2e17423b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:23:37 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-3be94991-a517-4958-823b-1e3d2e17423b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04" status: 200 len: 1076 microversion: 2.1 time: 0.130141 Apr 13 23:23:37 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 353/1065] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:23:37 2023] GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04 => generated 1076 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:23:38 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-07ea6ed7-0d2c-4d90-bee0-abdc846c9091 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:23:38 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-07ea6ed7-0d2c-4d90-bee0-abdc846c9091 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:23:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-07ea6ed7-0d2c-4d90-bee0-abdc846c9091 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-07ea6ed7-0d2c-4d90-bee0-abdc846c9091 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-07ea6ed7-0d2c-4d90-bee0-abdc846c9091 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-07ea6ed7-0d2c-4d90-bee0-abdc846c9091 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-07ea6ed7-0d2c-4d90-bee0-abdc846c9091 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-07ea6ed7-0d2c-4d90-bee0-abdc846c9091 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:38 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-07ea6ed7-0d2c-4d90-bee0-abdc846c9091 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050403 Apr 13 23:23:38 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 360/1066] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 23:23:38 2023] GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:23:38 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:23:38 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:23:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:38 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:23:38 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" status: 204 len: 0 microversion: 2.20 time: 0.111359 Apr 13 23:23:38 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 354/1067] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 23:23:38 2023] DELETE /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 23:23:38 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-899bf24b-615f-4622-adb3-1f9f85bb2784 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:23:38 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-899bf24b-615f-4622-adb3-1f9f85bb2784 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:23:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-899bf24b-615f-4622-adb3-1f9f85bb2784 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-899bf24b-615f-4622-adb3-1f9f85bb2784 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-899bf24b-615f-4622-adb3-1f9f85bb2784 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-899bf24b-615f-4622-adb3-1f9f85bb2784 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-899bf24b-615f-4622-adb3-1f9f85bb2784 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-899bf24b-615f-4622-adb3-1f9f85bb2784 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:38 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-899bf24b-615f-4622-adb3-1f9f85bb2784 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:23:38 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-899bf24b-615f-4622-adb3-1f9f85bb2784 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:23:38 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-899bf24b-615f-4622-adb3-1f9f85bb2784 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:23:38 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-899bf24b-615f-4622-adb3-1f9f85bb2784 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" status: 200 len: 1708 microversion: 2.20 time: 0.165463 Apr 13 23:23:38 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 354/1068] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:23:38 2023] GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 => generated 1708 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:23:38 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-78ce245e-864c-4eed-b72f-8232ad5cf548 req-ea08b3b2-6119-44c0-89cc-0243af7c50a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55", "name": "network-vif-unplugged", "status": "completed", "tag": "b3a3698d-6a99-43ff-8298-a59026248b01"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:23:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-78ce245e-864c-4eed-b72f-8232ad5cf548 req-ea08b3b2-6119-44c0-89cc-0243af7c50a4 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-78ce245e-864c-4eed-b72f-8232ad5cf548 req-ea08b3b2-6119-44c0-89cc-0243af7c50a4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-78ce245e-864c-4eed-b72f-8232ad5cf548 req-ea08b3b2-6119-44c0-89cc-0243af7c50a4 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:38 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-78ce245e-864c-4eed-b72f-8232ad5cf548 req-ea08b3b2-6119-44c0-89cc-0243af7c50a4 service nova] Creating event network-vif-unplugged:b3a3698d-6a99-43ff-8298-a59026248b01 for instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 on user Apr 13 23:23:39 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-78ce245e-864c-4eed-b72f-8232ad5cf548 req-ea08b3b2-6119-44c0-89cc-0243af7c50a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032490 Apr 13 23:23:39 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 361/1069] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:23:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:23:40 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-75eaa6d0-facc-4986-a3e6-4e3bb400ebba req-768a0ec0-d8dd-4f8b-97f6-5cd09a5c2ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ba1c8fe-0485-4d72-b82a-354c2b21ce04", "tag": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:23:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-75eaa6d0-facc-4986-a3e6-4e3bb400ebba req-768a0ec0-d8dd-4f8b-97f6-5cd09a5c2ca5 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-75eaa6d0-facc-4986-a3e6-4e3bb400ebba req-768a0ec0-d8dd-4f8b-97f6-5cd09a5c2ca5 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-75eaa6d0-facc-4986-a3e6-4e3bb400ebba req-768a0ec0-d8dd-4f8b-97f6-5cd09a5c2ca5 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:40 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-75eaa6d0-facc-4986-a3e6-4e3bb400ebba req-768a0ec0-d8dd-4f8b-97f6-5cd09a5c2ca5 service nova] Creating event network-changed:32c825d8-b7d0-42c1-b8bd-49b1d35821f9 for instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 on user Apr 13 23:23:40 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-75eaa6d0-facc-4986-a3e6-4e3bb400ebba req-768a0ec0-d8dd-4f8b-97f6-5cd09a5c2ca5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155655 Apr 13 23:23:40 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 355/1070] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:23:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:23:41 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-bdf9b512-d91a-4fa5-bb38-7b0b5a2cd037 req-39c565f8-b0c9-4e76-87be-5ba4f2493aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55", "name": "network-vif-plugged", "status": "completed", "tag": "b3a3698d-6a99-43ff-8298-a59026248b01"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:23:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-bdf9b512-d91a-4fa5-bb38-7b0b5a2cd037 req-39c565f8-b0c9-4e76-87be-5ba4f2493aaf service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-bdf9b512-d91a-4fa5-bb38-7b0b5a2cd037 req-39c565f8-b0c9-4e76-87be-5ba4f2493aaf service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-bdf9b512-d91a-4fa5-bb38-7b0b5a2cd037 req-39c565f8-b0c9-4e76-87be-5ba4f2493aaf service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:41 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-bdf9b512-d91a-4fa5-bb38-7b0b5a2cd037 req-39c565f8-b0c9-4e76-87be-5ba4f2493aaf service nova] Creating event network-vif-plugged:b3a3698d-6a99-43ff-8298-a59026248b01 for instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 on user Apr 13 23:23:41 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-bdf9b512-d91a-4fa5-bb38-7b0b5a2cd037 req-39c565f8-b0c9-4e76-87be-5ba4f2493aaf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033665 Apr 13 23:23:41 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 355/1071] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:23:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:23:42 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-5d69e543-6ac8-4a31-849c-4b5c6cce744e req-f2596a5f-3a50-4595-9693-9f7121123217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55", "name": "network-vif-deleted", "tag": "b3a3698d-6a99-43ff-8298-a59026248b01"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:23:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-5d69e543-6ac8-4a31-849c-4b5c6cce744e req-f2596a5f-3a50-4595-9693-9f7121123217 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-5d69e543-6ac8-4a31-849c-4b5c6cce744e req-f2596a5f-3a50-4595-9693-9f7121123217 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-5d69e543-6ac8-4a31-849c-4b5c6cce744e req-f2596a5f-3a50-4595-9693-9f7121123217 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:42 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-5d69e543-6ac8-4a31-849c-4b5c6cce744e req-f2596a5f-3a50-4595-9693-9f7121123217 service nova] Creating event network-vif-deleted:b3a3698d-6a99-43ff-8298-a59026248b01 for instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 on user Apr 13 23:23:42 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-5d69e543-6ac8-4a31-849c-4b5c6cce744e req-f2596a5f-3a50-4595-9693-9f7121123217 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029660 Apr 13 23:23:42 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 362/1072] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:23:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:23:46 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-d814676d-d89d-40cc-be07-30811a9fbf6d req-d7c0f2ae-3033-4ddc-98a1-962200c2de28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba1c8fe-0485-4d72-b82a-354c2b21ce04", "name": "network-vif-plugged", "status": "completed", "tag": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:23:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d814676d-d89d-40cc-be07-30811a9fbf6d req-d7c0f2ae-3033-4ddc-98a1-962200c2de28 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d814676d-d89d-40cc-be07-30811a9fbf6d req-d7c0f2ae-3033-4ddc-98a1-962200c2de28 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d814676d-d89d-40cc-be07-30811a9fbf6d req-d7c0f2ae-3033-4ddc-98a1-962200c2de28 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:46 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-d814676d-d89d-40cc-be07-30811a9fbf6d req-d7c0f2ae-3033-4ddc-98a1-962200c2de28 service nova] Creating event network-vif-plugged:32c825d8-b7d0-42c1-b8bd-49b1d35821f9 for instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 on user Apr 13 23:23:46 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-d814676d-d89d-40cc-be07-30811a9fbf6d req-d7c0f2ae-3033-4ddc-98a1-962200c2de28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055890 Apr 13 23:23:46 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 356/1073] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:23:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:23:48 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:23:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-744452d7-73bb-4c38-b255-bf8259c3c893 req-f8bd68f8-b839-4389-9a36-f3da67bdcb1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba1c8fe-0485-4d72-b82a-354c2b21ce04", "name": "network-vif-plugged", "status": "completed", "tag": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:23:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-744452d7-73bb-4c38-b255-bf8259c3c893 req-f8bd68f8-b839-4389-9a36-f3da67bdcb1c service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:23:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-744452d7-73bb-4c38-b255-bf8259c3c893 req-f8bd68f8-b839-4389-9a36-f3da67bdcb1c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:23:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-744452d7-73bb-4c38-b255-bf8259c3c893 req-f8bd68f8-b839-4389-9a36-f3da67bdcb1c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:23:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-744452d7-73bb-4c38-b255-bf8259c3c893 req-f8bd68f8-b839-4389-9a36-f3da67bdcb1c service nova] Creating event network-vif-plugged:32c825d8-b7d0-42c1-b8bd-49b1d35821f9 for instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 on user Apr 13 23:23:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-744452d7-73bb-4c38-b255-bf8259c3c893 req-f8bd68f8-b839-4389-9a36-f3da67bdcb1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034963 Apr 13 23:23:48 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 356/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:23:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:24:11 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:24:11 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:24:11 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:24:11 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:24:11 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=8 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:24:11 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:24:11 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=12 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:24:11 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:24:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:24:11 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-ce2abc04-73bc-4f0c-9a11-873e61462c7f req-4fa4bdaa-cdd3-496d-aa97-fcc5a141ebfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04eb8a55-c6d2-4a80-a818-060635d757a6", "tag": "60b18b3d-d206-49a4-81e4-f29a1b538a3c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:24:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:24:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:24:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:24:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:24:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:24:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-ce2abc04-73bc-4f0c-9a11-873e61462c7f req-4fa4bdaa-cdd3-496d-aa97-fcc5a141ebfe service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:24:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-ce2abc04-73bc-4f0c-9a11-873e61462c7f req-4fa4bdaa-cdd3-496d-aa97-fcc5a141ebfe service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:24:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-ce2abc04-73bc-4f0c-9a11-873e61462c7f req-4fa4bdaa-cdd3-496d-aa97-fcc5a141ebfe service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:24:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-ce2abc04-73bc-4f0c-9a11-873e61462c7f req-4fa4bdaa-cdd3-496d-aa97-fcc5a141ebfe service nova] Creating event network-changed:60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance 04eb8a55-c6d2-4a80-a818-060635d757a6 on user Apr 13 23:24:11 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:24:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-ce2abc04-73bc-4f0c-9a11-873e61462c7f req-4fa4bdaa-cdd3-496d-aa97-fcc5a141ebfe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046947 Apr 13 23:24:11 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 357/1075] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:24:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:24:12 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6" status: 204 len: 0 microversion: 2.1 time: 0.181794 Apr 13 23:24:12 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 363/1076] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:24:11 2023] DELETE /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:24:12 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=12 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:24:12 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=14 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:24:12 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-71ba1a91-eff3-47f6-8b34-109aed1ddc05 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:24:12 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-71ba1a91-eff3-47f6-8b34-109aed1ddc05 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:24:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-71ba1a91-eff3-47f6-8b34-109aed1ddc05 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:24:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-71ba1a91-eff3-47f6-8b34-109aed1ddc05 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:24:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-71ba1a91-eff3-47f6-8b34-109aed1ddc05 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:24:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-71ba1a91-eff3-47f6-8b34-109aed1ddc05 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:24:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-71ba1a91-eff3-47f6-8b34-109aed1ddc05 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:24:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-71ba1a91-eff3-47f6-8b34-109aed1ddc05 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:24:12 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-71ba1a91-eff3-47f6-8b34-109aed1ddc05 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271839d0073b49689368301d420c588a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405da8dd69654b3fb74203d0b7e26ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:24:12 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-71ba1a91-eff3-47f6-8b34-109aed1ddc05 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6" status: 200 len: 1556 microversion: 2.1 time: 0.249082 Apr 13 23:24:12 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 357/1077] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:24:12 2023] GET /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6 => generated 1556 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:24:13 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-0b5a4728-9bc0-45c5-969f-9c6383753e6a req-5c25a982-1806-4bcd-9568-b8ed6c8c1e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04eb8a55-c6d2-4a80-a818-060635d757a6", "name": "network-vif-deleted", "tag": "60b18b3d-d206-49a4-81e4-f29a1b538a3c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:24:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0b5a4728-9bc0-45c5-969f-9c6383753e6a req-5c25a982-1806-4bcd-9568-b8ed6c8c1e6f service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:24:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0b5a4728-9bc0-45c5-969f-9c6383753e6a req-5c25a982-1806-4bcd-9568-b8ed6c8c1e6f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:24:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0b5a4728-9bc0-45c5-969f-9c6383753e6a req-5c25a982-1806-4bcd-9568-b8ed6c8c1e6f service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:24:13 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-0b5a4728-9bc0-45c5-969f-9c6383753e6a req-5c25a982-1806-4bcd-9568-b8ed6c8c1e6f service nova] Creating event network-vif-deleted:60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance 04eb8a55-c6d2-4a80-a818-060635d757a6 on user Apr 13 23:24:13 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-0b5a4728-9bc0-45c5-969f-9c6383753e6a req-5c25a982-1806-4bcd-9568-b8ed6c8c1e6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027738 Apr 13 23:24:13 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 358/1078] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:24:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:24:13 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-3123770c-01a0-49b4-a27d-aea12a4947ce req-c11a7b35-1495-4197-b9f1-b5a5ef0f7cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04eb8a55-c6d2-4a80-a818-060635d757a6", "name": "network-vif-unplugged", "status": "completed", "tag": "60b18b3d-d206-49a4-81e4-f29a1b538a3c"}, {"server_uuid": "04eb8a55-c6d2-4a80-a818-060635d757a6", "name": "network-vif-plugged", "status": "completed", "tag": "60b18b3d-d206-49a4-81e4-f29a1b538a3c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:24:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3123770c-01a0-49b4-a27d-aea12a4947ce req-c11a7b35-1495-4197-b9f1-b5a5ef0f7cd6 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:24:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3123770c-01a0-49b4-a27d-aea12a4947ce req-c11a7b35-1495-4197-b9f1-b5a5ef0f7cd6 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:24:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3123770c-01a0-49b4-a27d-aea12a4947ce req-c11a7b35-1495-4197-b9f1-b5a5ef0f7cd6 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:24:14 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-3123770c-01a0-49b4-a27d-aea12a4947ce req-c11a7b35-1495-4197-b9f1-b5a5ef0f7cd6 service nova] Creating event network-vif-unplugged:60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance 04eb8a55-c6d2-4a80-a818-060635d757a6 on user Apr 13 23:24:14 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-3123770c-01a0-49b4-a27d-aea12a4947ce req-c11a7b35-1495-4197-b9f1-b5a5ef0f7cd6 service nova] Creating event network-vif-plugged:60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance 04eb8a55-c6d2-4a80-a818-060635d757a6 on user Apr 13 23:24:14 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-3123770c-01a0-49b4-a27d-aea12a4947ce req-c11a7b35-1495-4197-b9f1-b5a5ef0f7cd6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.051482 Apr 13 23:24:14 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 364/1079] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:24:13 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:24:27 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:24:27 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:24:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-de1a6f98-5bc3-47e4-879a-0f2b0bb791c3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:24:27 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-de1a6f98-5bc3-47e4-879a-0f2b0bb791c3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:24:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-de1a6f98-5bc3-47e4-879a-0f2b0bb791c3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:24:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-de1a6f98-5bc3-47e4-879a-0f2b0bb791c3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:24:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-de1a6f98-5bc3-47e4-879a-0f2b0bb791c3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:24:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-de1a6f98-5bc3-47e4-879a-0f2b0bb791c3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:24:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-de1a6f98-5bc3-47e4-879a-0f2b0bb791c3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:24:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-de1a6f98-5bc3-47e4-879a-0f2b0bb791c3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:24:27 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-de1a6f98-5bc3-47e4-879a-0f2b0bb791c3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:24:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-de1a6f98-5bc3-47e4-879a-0f2b0bb791c3 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04" status: 200 len: 1428 microversion: 2.1 time: 0.158405 Apr 13 23:24:27 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 358/1080] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:24:27 2023] GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04 => generated 1428 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:24:28 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:24:28 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:24:28 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f532d564-fb8b-404c-b2d5-64a512257932 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:24:28 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f532d564-fb8b-404c-b2d5-64a512257932 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:24:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f532d564-fb8b-404c-b2d5-64a512257932 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:24:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f532d564-fb8b-404c-b2d5-64a512257932 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:24:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f532d564-fb8b-404c-b2d5-64a512257932 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:24:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f532d564-fb8b-404c-b2d5-64a512257932 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:24:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f532d564-fb8b-404c-b2d5-64a512257932 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:24:28 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f532d564-fb8b-404c-b2d5-64a512257932 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:24:28 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-f532d564-fb8b-404c-b2d5-64a512257932 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] HTTP exception thrown: Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 could not be found. Apr 13 23:24:28 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f532d564-fb8b-404c-b2d5-64a512257932 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Request method failure captured: Apr 13 23:24:28 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 HTTP/1.1 Apr 13 23:24:28 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:24:28 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:24:28 user devstack@n-api.service[61611]: Connection: close Apr 13 23:24:28 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:24:28 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:24:28 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:24:28 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:24:28 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:24:28 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOI11KDFVoA-Mq1f-CiQvEozl4OwMulnX1XRQoPSo2AM_FhijWOXDbqFw1NBgF2IP63yoHa4B67zv1-7N8AzQNk3BaiD5QAkDuuggpPiOhYFcKmzVuwVbNJu2KWU-SkEBoEV09wVx-BC-SUqnhwoj7Rn0-R3Co9vBuxDcXeBXyxJr0LI Apr 13 23:24:28 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:24:28 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:24:28 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:24:28 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:24:28 user devstack@n-api.service[61611]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 23:24:28 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:24:28 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:24:28 user devstack@n-api.service[61611]: X-Project-Id: b9ad0d0e72ad43cca506267d62269910 Apr 13 23:24:28 user devstack@n-api.service[61611]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-953327095 Apr 13 23:24:28 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:24:28 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:24:28 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b9ad0d0e72ad43cca506267d62269910"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9ad0d0e72ad43cca506267d62269910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9ad0d0e72ad43cca506267d62269910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:24:28 user devstack@n-api.service[61611]: X-Tenant: tempest-AttachVolumeShelveTestJSON-953327095 Apr 13 23:24:28 user devstack@n-api.service[61611]: X-Tenant-Id: b9ad0d0e72ad43cca506267d62269910 Apr 13 23:24:28 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-953327095 Apr 13 23:24:28 user devstack@n-api.service[61611]: X-User: tempest-AttachVolumeShelveTestJSON-953327095-project-member Apr 13 23:24:28 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:24:28 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:24:28 user devstack@n-api.service[61611]: X-User-Id: e66f624501c3404bb1eb9412a8a6c951 Apr 13 23:24:28 user devstack@n-api.service[61611]: X-User-Name: tempest-AttachVolumeShelveTestJSON-953327095-project-member Apr 13 23:24:28 user devstack@n-api.service[61611]: method: > Apr 13 23:24:28 user devstack@n-api.service[61611]: exception: Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 could not be found. Apr 13 23:24:28 user devstack@n-api.service[61611]: action_args: {'id': '7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55'} Apr 13 23:24:28 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 could not be found. Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 could not be found. Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 could not be found. Apr 13 23:24:28 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:24:28 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f532d564-fb8b-404c-b2d5-64a512257932 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Returning 404 to user: Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:24:28 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f532d564-fb8b-404c-b2d5-64a512257932 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" status: 404 len: 111 microversion: 2.20 time: 0.040830 Apr 13 23:24:28 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 359/1081] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:24:28 2023] GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:24:28 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:24:28 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:24:28 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-664fc4c4-d011-4084-b23f-8f1e47e09f56 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '.version_select at 0x7f3d1e1b0670>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:24:28 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-664fc4c4-d011-4084-b23f-8f1e47e09f56 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-106580173" status: 204 len: 0 microversion: 2.20 time: 0.036030 Apr 13 23:24:28 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 365/1082] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 13 23:24:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-106580173 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 23:24:29 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-6f06097d-d5b1-4b40-8dc0-fb0448e41af5 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Action: 'create', calling method: .version_select at 0x7f3d1df36320>, body: {"keypair": {"name": "tempest-keypair-1255905063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvYa/qbohXL8t77LIIOS/oHQFIJOy9DvFTUSwa5laQz6hTF++BR/SJDTRnkzuy3ekPDiP1NzkwecHGwm8X+Lr9Sv3GYLMebgTDhY9CiZp0mH5fK3XDLzfE8aE5qXvlzaA=="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:24:29 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-6f06097d-d5b1-4b40-8dc0-fb0448e41af5 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Getting quotas for project b9ad0d0e72ad43cca506267d62269910. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:24:29 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-6f06097d-d5b1-4b40-8dc0-fb0448e41af5 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Getting quotas for user e66f624501c3404bb1eb9412a8a6c951 and project b9ad0d0e72ad43cca506267d62269910. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:24:29 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-6f06097d-d5b1-4b40-8dc0-fb0448e41af5 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.043149 Apr 13 23:24:29 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 359/1083] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 23:24:29 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 23:24:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-275106454", "imageRef": "d6970ace-53c3-48ed-ae08-e4c3846a312a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301"}], "security_groups": [{"name": "tempest-securitygroup--1248772654"}], "key_name": "tempest-keypair-1255905063", "user_data": "}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:24:31 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] validate_networks() for [('63f2f5eb-5e4d-439f-b38d-a0d5b96c5301', None, None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 23:24:32 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:24:32 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:24:32 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:24:32 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:24:32 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:24:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:24:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:24:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:24:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:24:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:24:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:24:32 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Getting quotas for project b9ad0d0e72ad43cca506267d62269910. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:24:32 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Getting quotas for user e66f624501c3404bb1eb9412a8a6c951 and project b9ad0d0e72ad43cca506267d62269910. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:24:32 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 23:24:32 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6970ace-53c3-48ed-ae08-e4c3846a312a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 23:24:32 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.745093 Apr 13 23:24:32 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 360/1084] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 23:24:31 2023] POST /compute/v2.1/servers => generated 400 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 23:24:32 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-2426d6cb-8b4c-4f14-9bce-60e4c1f322be tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:24:32 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-2426d6cb-8b4c-4f14-9bce-60e4c1f322be tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:24:32 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-2426d6cb-8b4c-4f14-9bce-60e4c1f322be tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:24:32 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-2426d6cb-8b4c-4f14-9bce-60e4c1f322be tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:24:32 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-2426d6cb-8b4c-4f14-9bce-60e4c1f322be tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:24:32 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-2426d6cb-8b4c-4f14-9bce-60e4c1f322be tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" status: 200 len: 1275 microversion: 2.20 time: 0.268881 Apr 13 23:24:32 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 366/1085] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:24:32 2023] GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a => generated 1275 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:24:34 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-6e55a783-01cd-4d59-9546-41107d84405c req-1d649fd4-7e27-410b-94ab-40975064df71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a", "tag": "35f2f7df-8994-44fe-af00-26d1a8f24c83"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:24:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6e55a783-01cd-4d59-9546-41107d84405c req-1d649fd4-7e27-410b-94ab-40975064df71 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:24:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6e55a783-01cd-4d59-9546-41107d84405c req-1d649fd4-7e27-410b-94ab-40975064df71 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:24:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6e55a783-01cd-4d59-9546-41107d84405c req-1d649fd4-7e27-410b-94ab-40975064df71 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:24:34 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-6e55a783-01cd-4d59-9546-41107d84405c req-1d649fd4-7e27-410b-94ab-40975064df71 service nova] Creating event network-changed:35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a on user Apr 13 23:24:34 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-6e55a783-01cd-4d59-9546-41107d84405c req-1d649fd4-7e27-410b-94ab-40975064df71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031203 Apr 13 23:24:34 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 360/1086] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:24:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:24:36 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-53b4cb96-3f21-48b7-8cd2-16d769c9bae8 req-823db6cc-068e-472c-adea-4e928fa8c98d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a", "name": "network-vif-plugged", "status": "completed", "tag": "35f2f7df-8994-44fe-af00-26d1a8f24c83"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:24:36 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-53b4cb96-3f21-48b7-8cd2-16d769c9bae8 req-823db6cc-068e-472c-adea-4e928fa8c98d service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:24:36 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-53b4cb96-3f21-48b7-8cd2-16d769c9bae8 req-823db6cc-068e-472c-adea-4e928fa8c98d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:24:36 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-53b4cb96-3f21-48b7-8cd2-16d769c9bae8 req-823db6cc-068e-472c-adea-4e928fa8c98d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:24:36 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-53b4cb96-3f21-48b7-8cd2-16d769c9bae8 req-823db6cc-068e-472c-adea-4e928fa8c98d service nova] Creating event network-vif-plugged:35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a on user Apr 13 23:24:36 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-53b4cb96-3f21-48b7-8cd2-16d769c9bae8 req-823db6cc-068e-472c-adea-4e928fa8c98d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030569 Apr 13 23:24:36 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 361/1087] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:24:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:24:38 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-2d31b211-9739-4b76-bcef-666683076f77 req-48984d2c-843e-4413-b295-4dc59022300a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a", "name": "network-vif-plugged", "status": "completed", "tag": "35f2f7df-8994-44fe-af00-26d1a8f24c83"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:24:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2d31b211-9739-4b76-bcef-666683076f77 req-48984d2c-843e-4413-b295-4dc59022300a service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:24:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2d31b211-9739-4b76-bcef-666683076f77 req-48984d2c-843e-4413-b295-4dc59022300a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:24:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2d31b211-9739-4b76-bcef-666683076f77 req-48984d2c-843e-4413-b295-4dc59022300a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:24:38 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-2d31b211-9739-4b76-bcef-666683076f77 req-48984d2c-843e-4413-b295-4dc59022300a service nova] Creating event network-vif-plugged:35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a on user Apr 13 23:24:38 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-2d31b211-9739-4b76-bcef-666683076f77 req-48984d2c-843e-4413-b295-4dc59022300a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036023 Apr 13 23:24:38 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 367/1088] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:24:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49c4da57-1294-4b5c-8e4e-0391f561071e] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 13 23:25:02 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:25:02 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:25:02 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=8 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:25:02 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-50ddb085-8c6d-4257-aadd-fef19f4a9b2d tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:25:02 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-50ddb085-8c6d-4257-aadd-fef19f4a9b2d tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:25:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-50ddb085-8c6d-4257-aadd-fef19f4a9b2d tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:25:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-50ddb085-8c6d-4257-aadd-fef19f4a9b2d tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:25:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-50ddb085-8c6d-4257-aadd-fef19f4a9b2d tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:25:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-50ddb085-8c6d-4257-aadd-fef19f4a9b2d tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:25:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-50ddb085-8c6d-4257-aadd-fef19f4a9b2d tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:25:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-50ddb085-8c6d-4257-aadd-fef19f4a9b2d tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:25:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-50ddb085-8c6d-4257-aadd-fef19f4a9b2d tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] HTTP exception thrown: Instance 04eb8a55-c6d2-4a80-a818-060635d757a6 could not be found. Apr 13 23:25:02 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-50ddb085-8c6d-4257-aadd-fef19f4a9b2d tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Request method failure captured: Apr 13 23:25:02 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6 HTTP/1.1 Apr 13 23:25:02 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:25:02 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:25:02 user devstack@n-api.service[61612]: Connection: close Apr 13 23:25:02 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:25:02 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:25:02 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:25:02 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:25:02 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:25:02 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOI2_mTpC7ItrC4ch_oqfRVatcjQ3ZUPDnun_kFDXpnpCnAFnlfnuRESU508YQnOnm_vQ56sAMJ9YcHv7MkFB06AUyOE39mExVKru4f3FLdpWeFhjFT66S-k0VdB78s7zl4vS0Q2NUiC90JXWnJjQscrt8chODh5twZ-LWJDOKkXkosw Apr 13 23:25:02 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:25:02 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:25:02 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:25:02 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:25:02 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:25:02 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:25:02 user devstack@n-api.service[61612]: X-Project-Id: 405da8dd69654b3fb74203d0b7e26ad2 Apr 13 23:25:02 user devstack@n-api.service[61612]: X-Project-Name: tempest-TestShelveInstance-1015090248 Apr 13 23:25:02 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:25:02 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:25:02 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/405da8dd69654b3fb74203d0b7e26ad2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/405da8dd69654b3fb74203d0b7e26ad2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/405da8dd69654b3fb74203d0b7e26ad2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:25:02 user devstack@n-api.service[61612]: X-Tenant: tempest-TestShelveInstance-1015090248 Apr 13 23:25:02 user devstack@n-api.service[61612]: X-Tenant-Id: 405da8dd69654b3fb74203d0b7e26ad2 Apr 13 23:25:02 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-TestShelveInstance-1015090248 Apr 13 23:25:02 user devstack@n-api.service[61612]: X-User: tempest-TestShelveInstance-1015090248-project-member Apr 13 23:25:02 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:25:02 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:25:02 user devstack@n-api.service[61612]: X-User-Id: 271839d0073b49689368301d420c588a Apr 13 23:25:02 user devstack@n-api.service[61612]: X-User-Name: tempest-TestShelveInstance-1015090248-project-member Apr 13 23:25:02 user devstack@n-api.service[61612]: method: > Apr 13 23:25:02 user devstack@n-api.service[61612]: exception: Instance 04eb8a55-c6d2-4a80-a818-060635d757a6 could not be found. Apr 13 23:25:02 user devstack@n-api.service[61612]: action_args: {'id': '04eb8a55-c6d2-4a80-a818-060635d757a6'} Apr 13 23:25:02 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04eb8a55-c6d2-4a80-a818-060635d757a6 could not be found. Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04eb8a55-c6d2-4a80-a818-060635d757a6 could not be found. Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04eb8a55-c6d2-4a80-a818-060635d757a6 could not be found. Apr 13 23:25:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:25:02 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-50ddb085-8c6d-4257-aadd-fef19f4a9b2d tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Returning 404 to user: Instance 04eb8a55-c6d2-4a80-a818-060635d757a6 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:25:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-50ddb085-8c6d-4257-aadd-fef19f4a9b2d tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6" status: 404 len: 111 microversion: 2.1 time: 0.041465 Apr 13 23:25:02 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 361/1089] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:25:02 2023] GET /compute/v2.1/servers/04eb8a55-c6d2-4a80-a818-060635d757a6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:25:02 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:25:02 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:25:02 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:25:02 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:25:02 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d0b41057-4aea-4ae0-84cb-66ef1fd57a49 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Calling method '.version_select at 0x7f3d1dfd1120>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:25:02 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-d0b41057-4aea-4ae0-84cb-66ef1fd57a49 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1980593566" status: 202 len: 0 microversion: 2.1 time: 0.032866 Apr 13 23:25:02 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 362/1090] 10.0.0.210 () {62 vars in 1331 bytes} [Thu Apr 13 23:25:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1980593566 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:25:22 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:25:22 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:25:22 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:25:22 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-101ef1b7-2285-42d3-bb04-5a04b29f117b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:25:22 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-101ef1b7-2285-42d3-bb04-5a04b29f117b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:25:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-101ef1b7-2285-42d3-bb04-5a04b29f117b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:25:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-101ef1b7-2285-42d3-bb04-5a04b29f117b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:25:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-101ef1b7-2285-42d3-bb04-5a04b29f117b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:25:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-101ef1b7-2285-42d3-bb04-5a04b29f117b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:25:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-101ef1b7-2285-42d3-bb04-5a04b29f117b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:25:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-101ef1b7-2285-42d3-bb04-5a04b29f117b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:25:22 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-101ef1b7-2285-42d3-bb04-5a04b29f117b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:25:22 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-101ef1b7-2285-42d3-bb04-5a04b29f117b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:25:22 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-101ef1b7-2285-42d3-bb04-5a04b29f117b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:25:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-101ef1b7-2285-42d3-bb04-5a04b29f117b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" status: 200 len: 1586 microversion: 2.20 time: 0.167984 Apr 13 23:25:22 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 368/1091] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:25:22 2023] GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a => generated 1586 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:25:28 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:25:28 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:25:28 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-a25211dd-f978-4e80-b791-3b1bcc97082c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:25:28 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-a25211dd-f978-4e80-b791-3b1bcc97082c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:25:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a25211dd-f978-4e80-b791-3b1bcc97082c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:25:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a25211dd-f978-4e80-b791-3b1bcc97082c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:25:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a25211dd-f978-4e80-b791-3b1bcc97082c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:25:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a25211dd-f978-4e80-b791-3b1bcc97082c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:25:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a25211dd-f978-4e80-b791-3b1bcc97082c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:25:28 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a25211dd-f978-4e80-b791-3b1bcc97082c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:25:28 user devstack@n-api.service[61612]: INFO oslo.messaging._drivers.impl_rabbit [-] [49c4da57-1294-4b5c-8e4e-0391f561071e] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 60294. Apr 13 23:25:28 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-a25211dd-f978-4e80-b791-3b1bcc97082c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.101576 Apr 13 23:25:28 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 362/1092] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 23:25:27 2023] GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04/os-interface => generated 282 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:25:29 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:25:29 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-5769153d-04b0-4c44-936b-b23826782a56 req-9ef38159-a2d7-4202-9edb-2848360c6adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5af8749-cd19-4828-b6f6-e3628da12f01", "tag": "1f5d0400-132c-4746-9b98-a86dfc3511af"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:25:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5769153d-04b0-4c44-936b-b23826782a56 req-9ef38159-a2d7-4202-9edb-2848360c6adc service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:25:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5769153d-04b0-4c44-936b-b23826782a56 req-9ef38159-a2d7-4202-9edb-2848360c6adc service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:25:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5769153d-04b0-4c44-936b-b23826782a56 req-9ef38159-a2d7-4202-9edb-2848360c6adc service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:25:29 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-5769153d-04b0-4c44-936b-b23826782a56 req-9ef38159-a2d7-4202-9edb-2848360c6adc service nova] Creating event network-changed:1f5d0400-132c-4746-9b98-a86dfc3511af for instance b5af8749-cd19-4828-b6f6-e3628da12f01 on user Apr 13 23:25:29 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-eb715ffe-6779-4e02-87eb-62789468f0e7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:25:29 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-eb715ffe-6779-4e02-87eb-62789468f0e7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:25:29 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-5769153d-04b0-4c44-936b-b23826782a56 req-9ef38159-a2d7-4202-9edb-2848360c6adc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045158 Apr 13 23:25:29 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 363/1093] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:25:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:25:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-eb715ffe-6779-4e02-87eb-62789468f0e7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:25:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-eb715ffe-6779-4e02-87eb-62789468f0e7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:25:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-eb715ffe-6779-4e02-87eb-62789468f0e7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:25:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-eb715ffe-6779-4e02-87eb-62789468f0e7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:25:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-eb715ffe-6779-4e02-87eb-62789468f0e7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:25:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-eb715ffe-6779-4e02-87eb-62789468f0e7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:25:29 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-eb715ffe-6779-4e02-87eb-62789468f0e7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:25:29 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-eb715ffe-6779-4e02-87eb-62789468f0e7 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04" status: 200 len: 1428 microversion: 2.1 time: 0.163797 Apr 13 23:25:29 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 369/1094] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:25:29 2023] GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04 => generated 1428 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Old instance type m1.nano, new instance type m1.micro {{(pid=61612) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting quotas for project 68330047a5fd4e4397cf5edca18c5b51. Resources: {'ram', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting quotas for user 59b2c11a23384f678a086de89139497d and project 68330047a5fd4e4397cf5edca18c5b51. Resources: {'ram', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 23:25:29 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 23:25:29 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04/action" status: 202 len: 0 microversion: 2.1 time: 0.165474 Apr 13 23:25:29 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 363/1095] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 23:25:29 2023] POST /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 23:25:29 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-ef2c9ed3-95dd-4b36-a4ab-aff80cbb474b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:25:29 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-ef2c9ed3-95dd-4b36-a4ab-aff80cbb474b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:25:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ef2c9ed3-95dd-4b36-a4ab-aff80cbb474b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:25:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ef2c9ed3-95dd-4b36-a4ab-aff80cbb474b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:25:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ef2c9ed3-95dd-4b36-a4ab-aff80cbb474b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:25:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ef2c9ed3-95dd-4b36-a4ab-aff80cbb474b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:25:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ef2c9ed3-95dd-4b36-a4ab-aff80cbb474b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:25:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ef2c9ed3-95dd-4b36-a4ab-aff80cbb474b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:25:29 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-ef2c9ed3-95dd-4b36-a4ab-aff80cbb474b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:25:29 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-ef2c9ed3-95dd-4b36-a4ab-aff80cbb474b tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04" status: 200 len: 1437 microversion: 2.1 time: 0.193258 Apr 13 23:25:29 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 364/1096] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:25:29 2023] GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04 => generated 1437 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:25:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-a36345c6-d1e6-4d3c-96d4-f7175ea40525 req-f2c6643b-6516-4e33-8b83-6f653ead9321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ba1c8fe-0485-4d72-b82a-354c2b21ce04", "tag": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:25:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a36345c6-d1e6-4d3c-96d4-f7175ea40525 req-f2c6643b-6516-4e33-8b83-6f653ead9321 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:25:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a36345c6-d1e6-4d3c-96d4-f7175ea40525 req-f2c6643b-6516-4e33-8b83-6f653ead9321 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:25:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a36345c6-d1e6-4d3c-96d4-f7175ea40525 req-f2c6643b-6516-4e33-8b83-6f653ead9321 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:25:31 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-a36345c6-d1e6-4d3c-96d4-f7175ea40525 req-f2c6643b-6516-4e33-8b83-6f653ead9321 service nova] Creating event network-changed:32c825d8-b7d0-42c1-b8bd-49b1d35821f9 for instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 on user Apr 13 23:25:31 user devstack@n-api.service[61613]: DEBUG nova.compute.api [req-a36345c6-d1e6-4d3c-96d4-f7175ea40525 req-f2c6643b-6516-4e33-8b83-6f653ead9321 service nova] Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 23:25:31 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-a36345c6-d1e6-4d3c-96d4-f7175ea40525 req-f2c6643b-6516-4e33-8b83-6f653ead9321 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039559 Apr 13 23:25:31 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 370/1097] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:25:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:25:31 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-776543a3-6062-41c3-bc24-3d57ba0984c6 req-ce936b4e-34b9-4f92-9347-2b8478eccb2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba1c8fe-0485-4d72-b82a-354c2b21ce04", "name": "network-vif-unplugged", "status": "completed", "tag": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:25:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-776543a3-6062-41c3-bc24-3d57ba0984c6 req-ce936b4e-34b9-4f92-9347-2b8478eccb2b service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:25:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-776543a3-6062-41c3-bc24-3d57ba0984c6 req-ce936b4e-34b9-4f92-9347-2b8478eccb2b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:25:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-776543a3-6062-41c3-bc24-3d57ba0984c6 req-ce936b4e-34b9-4f92-9347-2b8478eccb2b service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:25:31 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-776543a3-6062-41c3-bc24-3d57ba0984c6 req-ce936b4e-34b9-4f92-9347-2b8478eccb2b service nova] Creating event network-vif-unplugged:32c825d8-b7d0-42c1-b8bd-49b1d35821f9 for instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 on user Apr 13 23:25:31 user devstack@n-api.service[61612]: DEBUG nova.compute.api [req-776543a3-6062-41c3-bc24-3d57ba0984c6 req-ce936b4e-34b9-4f92-9347-2b8478eccb2b service nova] Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 23:25:31 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-776543a3-6062-41c3-bc24-3d57ba0984c6 req-ce936b4e-34b9-4f92-9347-2b8478eccb2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.230538 Apr 13 23:25:31 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 364/1098] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:25:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:25:33 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-97193bd9-0782-4855-bedf-d2d71ee934e5 req-f7c74864-65f4-4499-944a-e6c04ff01776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba1c8fe-0485-4d72-b82a-354c2b21ce04", "name": "network-vif-plugged", "status": "completed", "tag": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:25:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-97193bd9-0782-4855-bedf-d2d71ee934e5 req-f7c74864-65f4-4499-944a-e6c04ff01776 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:25:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-97193bd9-0782-4855-bedf-d2d71ee934e5 req-f7c74864-65f4-4499-944a-e6c04ff01776 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:25:33 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-97193bd9-0782-4855-bedf-d2d71ee934e5 req-f7c74864-65f4-4499-944a-e6c04ff01776 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:25:33 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-97193bd9-0782-4855-bedf-d2d71ee934e5 req-f7c74864-65f4-4499-944a-e6c04ff01776 service nova] Creating event network-vif-plugged:32c825d8-b7d0-42c1-b8bd-49b1d35821f9 for instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 on user Apr 13 23:25:33 user devstack@n-api.service[61611]: DEBUG nova.compute.api [req-97193bd9-0782-4855-bedf-d2d71ee934e5 req-f7c74864-65f4-4499-944a-e6c04ff01776 service nova] Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61611) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 23:25:33 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-97193bd9-0782-4855-bedf-d2d71ee934e5 req-f7c74864-65f4-4499-944a-e6c04ff01776 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037132 Apr 13 23:25:33 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 365/1099] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:25:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:25:41 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:25:41 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=16 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:25:41 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-7841a13f-6471-4997-8924-76c74b8263cd req-54d84cf2-6da4-4c01-9b28-46a3c16222ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba1c8fe-0485-4d72-b82a-354c2b21ce04", "name": "network-vif-plugged", "status": "completed", "tag": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:25:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-7841a13f-6471-4997-8924-76c74b8263cd req-54d84cf2-6da4-4c01-9b28-46a3c16222ae service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:25:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-7841a13f-6471-4997-8924-76c74b8263cd req-54d84cf2-6da4-4c01-9b28-46a3c16222ae service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:25:41 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-7841a13f-6471-4997-8924-76c74b8263cd req-54d84cf2-6da4-4c01-9b28-46a3c16222ae service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:25:41 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-7841a13f-6471-4997-8924-76c74b8263cd req-54d84cf2-6da4-4c01-9b28-46a3c16222ae service nova] Creating event network-vif-plugged:32c825d8-b7d0-42c1-b8bd-49b1d35821f9 for instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 on user Apr 13 23:25:41 user devstack@n-api.service[61613]: DEBUG nova.compute.api [req-7841a13f-6471-4997-8924-76c74b8263cd req-54d84cf2-6da4-4c01-9b28-46a3c16222ae service nova] Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 23:25:41 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-7841a13f-6471-4997-8924-76c74b8263cd req-54d84cf2-6da4-4c01-9b28-46a3c16222ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043760 Apr 13 23:25:41 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 371/1100] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:25:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:25:43 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:25:43 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=18 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:25:43 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:25:43 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-0286689d-3ba2-4783-92d5-72c1c6822412 req-fc4e3971-6daa-43ea-8a0d-ad38426f31fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba1c8fe-0485-4d72-b82a-354c2b21ce04", "name": "network-vif-plugged", "status": "completed", "tag": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:25:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-0286689d-3ba2-4783-92d5-72c1c6822412 req-fc4e3971-6daa-43ea-8a0d-ad38426f31fa service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:25:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-0286689d-3ba2-4783-92d5-72c1c6822412 req-fc4e3971-6daa-43ea-8a0d-ad38426f31fa service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:25:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-0286689d-3ba2-4783-92d5-72c1c6822412 req-fc4e3971-6daa-43ea-8a0d-ad38426f31fa service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:25:43 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-0286689d-3ba2-4783-92d5-72c1c6822412 req-fc4e3971-6daa-43ea-8a0d-ad38426f31fa service nova] Creating event network-vif-plugged:32c825d8-b7d0-42c1-b8bd-49b1d35821f9 for instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 on user Apr 13 23:25:43 user devstack@n-api.service[61612]: DEBUG nova.compute.api [req-0286689d-3ba2-4783-92d5-72c1c6822412 req-fc4e3971-6daa-43ea-8a0d-ad38426f31fa service nova] Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 23:25:43 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-0286689d-3ba2-4783-92d5-72c1c6822412 req-fc4e3971-6daa-43ea-8a0d-ad38426f31fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044138 Apr 13 23:25:43 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 365/1101] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:25:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:26:19 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:26:19 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=12 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:26:19 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-87e632d3-3a42-4184-b71f-b4f19fdc00e9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:26:19 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-87e632d3-3a42-4184-b71f-b4f19fdc00e9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:26:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-87e632d3-3a42-4184-b71f-b4f19fdc00e9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:26:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-87e632d3-3a42-4184-b71f-b4f19fdc00e9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:26:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-87e632d3-3a42-4184-b71f-b4f19fdc00e9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:26:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-87e632d3-3a42-4184-b71f-b4f19fdc00e9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:26:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-87e632d3-3a42-4184-b71f-b4f19fdc00e9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:26:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-87e632d3-3a42-4184-b71f-b4f19fdc00e9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:26:19 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-87e632d3-3a42-4184-b71f-b4f19fdc00e9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:26:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-87e632d3-3a42-4184-b71f-b4f19fdc00e9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04" status: 200 len: 1554 microversion: 2.1 time: 0.176068 Apr 13 23:26:19 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 366/1102] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:26:19 2023] GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:26:22 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:26:22 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:26:22 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-61fa0559-7c1a-419d-8e94-8ff45c6c9496 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:26:22 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-61fa0559-7c1a-419d-8e94-8ff45c6c9496 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:26:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-61fa0559-7c1a-419d-8e94-8ff45c6c9496 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:26:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-61fa0559-7c1a-419d-8e94-8ff45c6c9496 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:26:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-61fa0559-7c1a-419d-8e94-8ff45c6c9496 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:26:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-61fa0559-7c1a-419d-8e94-8ff45c6c9496 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:26:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-61fa0559-7c1a-419d-8e94-8ff45c6c9496 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:26:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-61fa0559-7c1a-419d-8e94-8ff45c6c9496 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:26:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-61fa0559-7c1a-419d-8e94-8ff45c6c9496 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.102420 Apr 13 23:26:22 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 372/1103] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 23:26:22 2023] GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/os-interface => generated 283 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 23:26:23 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:26:23 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:26:23 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-63ca0469-91e8-4cab-8476-78d22340cccb tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:26:23 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-63ca0469-91e8-4cab-8476-78d22340cccb tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:26:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-63ca0469-91e8-4cab-8476-78d22340cccb tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:26:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-63ca0469-91e8-4cab-8476-78d22340cccb tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:26:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-63ca0469-91e8-4cab-8476-78d22340cccb tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:26:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-63ca0469-91e8-4cab-8476-78d22340cccb tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:26:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-63ca0469-91e8-4cab-8476-78d22340cccb tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:26:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-63ca0469-91e8-4cab-8476-78d22340cccb tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:26:23 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-51e3ccb6-5d7f-4824-bf06-7c9c7c19f74c req-959889f0-3c61-4113-b292-95168040427c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a", "tag": "35f2f7df-8994-44fe-af00-26d1a8f24c83"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:26:23 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-63ca0469-91e8-4cab-8476-78d22340cccb tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/ips" status: 200 len: 109 microversion: 2.20 time: 0.036188 Apr 13 23:26:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-51e3ccb6-5d7f-4824-bf06-7c9c7c19f74c req-959889f0-3c61-4113-b292-95168040427c service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:26:23 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 367/1104] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 13 23:26:23 2023] GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/ips => generated 109 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 23:26:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-51e3ccb6-5d7f-4824-bf06-7c9c7c19f74c req-959889f0-3c61-4113-b292-95168040427c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:26:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-51e3ccb6-5d7f-4824-bf06-7c9c7c19f74c req-959889f0-3c61-4113-b292-95168040427c service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:26:23 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-51e3ccb6-5d7f-4824-bf06-7c9c7c19f74c req-959889f0-3c61-4113-b292-95168040427c service nova] Creating event network-changed:35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a on user Apr 13 23:26:23 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-51e3ccb6-5d7f-4824-bf06-7c9c7c19f74c req-959889f0-3c61-4113-b292-95168040427c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090831 Apr 13 23:26:23 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 366/1105] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:26:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:26:26 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:26:26 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:26:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:26:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:26:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:26:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:26:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:26:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:26:26 user devstack@n-api.service[61613]: DEBUG nova.objects.instance [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'flavor' on Instance uuid f06f6eff-76a8-4c0a-9e11-b49b0c09e22a {{(pid=61613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 23:26:27 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/action" status: 202 len: 0 microversion: 2.20 time: 0.846284 Apr 13 23:26:27 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 373/1106] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 23:26:26 2023] POST /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/action => generated 0 bytes in 848 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:26:27 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-bcdce328-0bbc-4b0b-abe4-a5977e87ef4d tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:26:27 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-bcdce328-0bbc-4b0b-abe4-a5977e87ef4d tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:26:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bcdce328-0bbc-4b0b-abe4-a5977e87ef4d tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:26:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bcdce328-0bbc-4b0b-abe4-a5977e87ef4d tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:26:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bcdce328-0bbc-4b0b-abe4-a5977e87ef4d tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:26:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bcdce328-0bbc-4b0b-abe4-a5977e87ef4d tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:26:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bcdce328-0bbc-4b0b-abe4-a5977e87ef4d tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:26:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bcdce328-0bbc-4b0b-abe4-a5977e87ef4d tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:26:27 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-bcdce328-0bbc-4b0b-abe4-a5977e87ef4d tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:26:27 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-bcdce328-0bbc-4b0b-abe4-a5977e87ef4d tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:26:27 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-bcdce328-0bbc-4b0b-abe4-a5977e87ef4d tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:26:27 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-bcdce328-0bbc-4b0b-abe4-a5977e87ef4d tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" status: 200 len: 1711 microversion: 2.20 time: 0.222198 Apr 13 23:26:27 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 368/1107] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:26:27 2023] GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a => generated 1711 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:26:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-0fc22885-c67f-477a-a981-3ef0b4518bda req-91a8caf6-9e5d-4e17-b710-6a98b8d57b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a", "name": "network-vif-unplugged", "status": "completed", "tag": "35f2f7df-8994-44fe-af00-26d1a8f24c83"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:26:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-0fc22885-c67f-477a-a981-3ef0b4518bda req-91a8caf6-9e5d-4e17-b710-6a98b8d57b11 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:26:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-0fc22885-c67f-477a-a981-3ef0b4518bda req-91a8caf6-9e5d-4e17-b710-6a98b8d57b11 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:26:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-0fc22885-c67f-477a-a981-3ef0b4518bda req-91a8caf6-9e5d-4e17-b710-6a98b8d57b11 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:26:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-0fc22885-c67f-477a-a981-3ef0b4518bda req-91a8caf6-9e5d-4e17-b710-6a98b8d57b11 service nova] Creating event network-vif-unplugged:35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a on user Apr 13 23:26:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-0fc22885-c67f-477a-a981-3ef0b4518bda req-91a8caf6-9e5d-4e17-b710-6a98b8d57b11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032663 Apr 13 23:26:27 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 367/1108] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:26:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:26:29 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-0f1ea1bc-a3e8-413b-ac74-025b46c94ce8 req-5f05d1f7-e939-47ef-92dc-6ae96c8c7864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a", "name": "network-vif-plugged", "status": "completed", "tag": "35f2f7df-8994-44fe-af00-26d1a8f24c83"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:26:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0f1ea1bc-a3e8-413b-ac74-025b46c94ce8 req-5f05d1f7-e939-47ef-92dc-6ae96c8c7864 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:26:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0f1ea1bc-a3e8-413b-ac74-025b46c94ce8 req-5f05d1f7-e939-47ef-92dc-6ae96c8c7864 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:26:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0f1ea1bc-a3e8-413b-ac74-025b46c94ce8 req-5f05d1f7-e939-47ef-92dc-6ae96c8c7864 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:26:29 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-0f1ea1bc-a3e8-413b-ac74-025b46c94ce8 req-5f05d1f7-e939-47ef-92dc-6ae96c8c7864 service nova] Creating event network-vif-plugged:35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a on user Apr 13 23:26:29 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-0f1ea1bc-a3e8-413b-ac74-025b46c94ce8 req-5f05d1f7-e939-47ef-92dc-6ae96c8c7864 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032895 Apr 13 23:26:29 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 374/1109] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:26:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:26:31 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-41749224-0efa-4a7f-aa16-5129566abe22 req-cb0299f6-3cde-4f5c-a46e-7c9cacaa81ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a", "tag": "35f2f7df-8994-44fe-af00-26d1a8f24c83"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:26:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-41749224-0efa-4a7f-aa16-5129566abe22 req-cb0299f6-3cde-4f5c-a46e-7c9cacaa81ba service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:26:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-41749224-0efa-4a7f-aa16-5129566abe22 req-cb0299f6-3cde-4f5c-a46e-7c9cacaa81ba service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:26:31 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-41749224-0efa-4a7f-aa16-5129566abe22 req-cb0299f6-3cde-4f5c-a46e-7c9cacaa81ba service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:26:31 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-41749224-0efa-4a7f-aa16-5129566abe22 req-cb0299f6-3cde-4f5c-a46e-7c9cacaa81ba service nova] Creating event network-changed:35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a on user Apr 13 23:26:31 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-41749224-0efa-4a7f-aa16-5129566abe22 req-cb0299f6-3cde-4f5c-a46e-7c9cacaa81ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031440 Apr 13 23:26:31 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 369/1110] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:26:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:27:17 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:27:17 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:27:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-e4b76dbc-d7ad-49d6-9c3c-cc5acc8553c7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:27:17 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-e4b76dbc-d7ad-49d6-9c3c-cc5acc8553c7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:27:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e4b76dbc-d7ad-49d6-9c3c-cc5acc8553c7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:27:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e4b76dbc-d7ad-49d6-9c3c-cc5acc8553c7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:27:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e4b76dbc-d7ad-49d6-9c3c-cc5acc8553c7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:27:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e4b76dbc-d7ad-49d6-9c3c-cc5acc8553c7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:27:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e4b76dbc-d7ad-49d6-9c3c-cc5acc8553c7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:27:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e4b76dbc-d7ad-49d6-9c3c-cc5acc8553c7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:27:17 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-e4b76dbc-d7ad-49d6-9c3c-cc5acc8553c7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:27:17 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-e4b76dbc-d7ad-49d6-9c3c-cc5acc8553c7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:27:17 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-e4b76dbc-d7ad-49d6-9c3c-cc5acc8553c7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:27:17 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-e4b76dbc-d7ad-49d6-9c3c-cc5acc8553c7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" status: 200 len: 1652 microversion: 2.20 time: 0.282904 Apr 13 23:27:17 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 368/1111] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:27:17 2023] GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a => generated 1652 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:27:19 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:27:19 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:27:19 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:27:19 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:27:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:27:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:27:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:27:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:27:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:27:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:27:20 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04/action" status: 204 len: 0 microversion: 2.1 time: 0.089524 Apr 13 23:27:20 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 375/1112] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 23:27:19 2023] POST /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04/action => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:27:20 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=8 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:27:20 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=18 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:27:20 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-26da870e-59bd-47a6-b571-e8bd6b52a3c9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:27:20 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-26da870e-59bd-47a6-b571-e8bd6b52a3c9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:27:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-26da870e-59bd-47a6-b571-e8bd6b52a3c9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:27:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-26da870e-59bd-47a6-b571-e8bd6b52a3c9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:27:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-26da870e-59bd-47a6-b571-e8bd6b52a3c9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:27:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-26da870e-59bd-47a6-b571-e8bd6b52a3c9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:27:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-26da870e-59bd-47a6-b571-e8bd6b52a3c9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:27:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-26da870e-59bd-47a6-b571-e8bd6b52a3c9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:27:20 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-26da870e-59bd-47a6-b571-e8bd6b52a3c9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:27:20 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-26da870e-59bd-47a6-b571-e8bd6b52a3c9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04" status: 200 len: 1554 microversion: 2.1 time: 0.156667 Apr 13 23:27:20 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 370/1113] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:27:20 2023] GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:28:10 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:28:10 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:28:10 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-4bd8810b-c387-41a6-ae6a-bcd82a848953 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:28:10 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-4bd8810b-c387-41a6-ae6a-bcd82a848953 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:28:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4bd8810b-c387-41a6-ae6a-bcd82a848953 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:28:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4bd8810b-c387-41a6-ae6a-bcd82a848953 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:28:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4bd8810b-c387-41a6-ae6a-bcd82a848953 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:28:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4bd8810b-c387-41a6-ae6a-bcd82a848953 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:28:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4bd8810b-c387-41a6-ae6a-bcd82a848953 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:28:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4bd8810b-c387-41a6-ae6a-bcd82a848953 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:28:10 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-4bd8810b-c387-41a6-ae6a-bcd82a848953 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:28:10 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-4bd8810b-c387-41a6-ae6a-bcd82a848953 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04" status: 200 len: 1546 microversion: 2.1 time: 0.173009 Apr 13 23:28:10 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 369/1114] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:28:10 2023] GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04 => generated 1546 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:28:17 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:28:17 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:28:17 user devstack@n-api.service[61613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 23:28:17 user devstack@n-api.service[61613]: Thu Apr 13 23:28:17 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/os-volume_attachments (ip 10.0.0.210) !!! Apr 13 23:28:18 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-4a65394c-1ef2-4f2a-ac0b-6b74185aa1ed tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b11a4667-9c71-4aa8-a7f4-b21668711de8"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:28:18 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-4a65394c-1ef2-4f2a-ac0b-6b74185aa1ed tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:28:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4a65394c-1ef2-4f2a-ac0b-6b74185aa1ed tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:28:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4a65394c-1ef2-4f2a-ac0b-6b74185aa1ed tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:28:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4a65394c-1ef2-4f2a-ac0b-6b74185aa1ed tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:28:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4a65394c-1ef2-4f2a-ac0b-6b74185aa1ed tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:28:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4a65394c-1ef2-4f2a-ac0b-6b74185aa1ed tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:28:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4a65394c-1ef2-4f2a-ac0b-6b74185aa1ed tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:28:18 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-4a65394c-1ef2-4f2a-ac0b-6b74185aa1ed tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.466418 Apr 13 23:28:18 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 376/1115] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 23:28:17 2023] POST /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/os-volume_attachments => generated 188 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 23:28:18 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-248ba91b-687c-49e0-af4e-0da0a122164a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:28:18 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-248ba91b-687c-49e0-af4e-0da0a122164a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:28:18 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:28:18 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:28:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-248ba91b-687c-49e0-af4e-0da0a122164a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:28:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-248ba91b-687c-49e0-af4e-0da0a122164a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:28:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-248ba91b-687c-49e0-af4e-0da0a122164a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:28:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-248ba91b-687c-49e0-af4e-0da0a122164a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:28:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-248ba91b-687c-49e0-af4e-0da0a122164a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:28:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-248ba91b-687c-49e0-af4e-0da0a122164a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:28:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-248ba91b-687c-49e0-af4e-0da0a122164a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/os-volume_attachments/b11a4667-9c71-4aa8-a7f4-b21668711de8" status: 202 len: 0 microversion: 2.20 time: 0.275323 Apr 13 23:28:18 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 371/1116] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 23:28:18 2023] DELETE /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/os-volume_attachments/b11a4667-9c71-4aa8-a7f4-b21668711de8 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:28:18 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:28:18 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:28:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:28:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:28:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:28:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:28:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:28:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:28:19 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61612) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 23:28:19 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/action" status: 202 len: 0 microversion: 2.20 time: 0.180590 Apr 13 23:28:19 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 370/1117] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 23:28:18 2023] POST /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:28:19 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-237a5f25-b7a5-4dbd-a328-fbcd102f1cf4 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:28:19 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-237a5f25-b7a5-4dbd-a328-fbcd102f1cf4 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:28:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-237a5f25-b7a5-4dbd-a328-fbcd102f1cf4 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:28:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-237a5f25-b7a5-4dbd-a328-fbcd102f1cf4 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:28:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-237a5f25-b7a5-4dbd-a328-fbcd102f1cf4 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:28:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-237a5f25-b7a5-4dbd-a328-fbcd102f1cf4 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:28:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-237a5f25-b7a5-4dbd-a328-fbcd102f1cf4 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:28:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-237a5f25-b7a5-4dbd-a328-fbcd102f1cf4 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:28:19 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-237a5f25-b7a5-4dbd-a328-fbcd102f1cf4 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:28:19 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-237a5f25-b7a5-4dbd-a328-fbcd102f1cf4 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:28:19 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-237a5f25-b7a5-4dbd-a328-fbcd102f1cf4 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:28:19 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-237a5f25-b7a5-4dbd-a328-fbcd102f1cf4 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" status: 200 len: 1660 microversion: 2.20 time: 0.196277 Apr 13 23:28:19 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 377/1118] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:28:19 2023] GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a => generated 1660 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:28:21 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-fae552f3-d227-4797-b072-ea62f36c9273 req-b7895283-acae-48b5-894c-4f35d67f69ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a", "tag": "35f2f7df-8994-44fe-af00-26d1a8f24c83"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:28:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-fae552f3-d227-4797-b072-ea62f36c9273 req-b7895283-acae-48b5-894c-4f35d67f69ac service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:28:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-fae552f3-d227-4797-b072-ea62f36c9273 req-b7895283-acae-48b5-894c-4f35d67f69ac service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:28:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-fae552f3-d227-4797-b072-ea62f36c9273 req-b7895283-acae-48b5-894c-4f35d67f69ac service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:28:21 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-fae552f3-d227-4797-b072-ea62f36c9273 req-b7895283-acae-48b5-894c-4f35d67f69ac service nova] Creating event network-changed:35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a on user Apr 13 23:28:21 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-fae552f3-d227-4797-b072-ea62f36c9273 req-b7895283-acae-48b5-894c-4f35d67f69ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028962 Apr 13 23:28:21 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 372/1119] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:28:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:28:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-2601ca61-e169-4ebb-bc2e-8a9083e648b7 req-b7709feb-0159-4deb-9498-d2484f98c7ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a", "name": "network-vif-plugged", "status": "completed", "tag": "35f2f7df-8994-44fe-af00-26d1a8f24c83"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:28:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-2601ca61-e169-4ebb-bc2e-8a9083e648b7 req-b7709feb-0159-4deb-9498-d2484f98c7ae service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:28:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-2601ca61-e169-4ebb-bc2e-8a9083e648b7 req-b7709feb-0159-4deb-9498-d2484f98c7ae service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:28:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-2601ca61-e169-4ebb-bc2e-8a9083e648b7 req-b7709feb-0159-4deb-9498-d2484f98c7ae service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:28:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-2601ca61-e169-4ebb-bc2e-8a9083e648b7 req-b7709feb-0159-4deb-9498-d2484f98c7ae service nova] Creating event network-vif-plugged:35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a on user Apr 13 23:28:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-2601ca61-e169-4ebb-bc2e-8a9083e648b7 req-b7709feb-0159-4deb-9498-d2484f98c7ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040951 Apr 13 23:28:27 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 371/1120] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:28:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:28:29 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-10dbe5eb-0ab8-4775-b7cb-45f4296e6338 req-dc4e3fe5-8cb8-491c-86d6-e1db5522ec66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a", "name": "network-vif-plugged", "status": "completed", "tag": "35f2f7df-8994-44fe-af00-26d1a8f24c83"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:28:29 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:28:29 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:28:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-10dbe5eb-0ab8-4775-b7cb-45f4296e6338 req-dc4e3fe5-8cb8-491c-86d6-e1db5522ec66 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:28:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-10dbe5eb-0ab8-4775-b7cb-45f4296e6338 req-dc4e3fe5-8cb8-491c-86d6-e1db5522ec66 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:28:29 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-10dbe5eb-0ab8-4775-b7cb-45f4296e6338 req-dc4e3fe5-8cb8-491c-86d6-e1db5522ec66 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:28:29 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-10dbe5eb-0ab8-4775-b7cb-45f4296e6338 req-dc4e3fe5-8cb8-491c-86d6-e1db5522ec66 service nova] Creating event network-vif-plugged:35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a on user Apr 13 23:28:29 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-10dbe5eb-0ab8-4775-b7cb-45f4296e6338 req-dc4e3fe5-8cb8-491c-86d6-e1db5522ec66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036898 Apr 13 23:28:29 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 378/1121] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:28:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:29:09 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:29:09 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:29:09 user devstack@n-api.service[61611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 23:29:09 user devstack@n-api.service[61611]: Thu Apr 13 23:29:09 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a (ip 10.0.0.210) !!! Apr 13 23:29:09 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5007475d-e47d-4864-a015-061b452f0805 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:29:09 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-5007475d-e47d-4864-a015-061b452f0805 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:29:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5007475d-e47d-4864-a015-061b452f0805 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:29:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5007475d-e47d-4864-a015-061b452f0805 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:29:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5007475d-e47d-4864-a015-061b452f0805 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:29:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5007475d-e47d-4864-a015-061b452f0805 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:29:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5007475d-e47d-4864-a015-061b452f0805 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:29:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-5007475d-e47d-4864-a015-061b452f0805 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:29:09 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-5007475d-e47d-4864-a015-061b452f0805 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:29:09 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-5007475d-e47d-4864-a015-061b452f0805 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:29:09 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-5007475d-e47d-4864-a015-061b452f0805 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:29:09 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-5007475d-e47d-4864-a015-061b452f0805 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" status: 200 len: 1705 microversion: 2.20 time: 0.283673 Apr 13 23:29:09 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 373/1122] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:29:09 2023] GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a => generated 1705 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:29:10 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:29:10 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:29:10 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-530933ca-fac5-4d80-96f9-257f383bb453 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:29:10 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-530933ca-fac5-4d80-96f9-257f383bb453 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:29:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-530933ca-fac5-4d80-96f9-257f383bb453 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:29:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-530933ca-fac5-4d80-96f9-257f383bb453 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:29:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-530933ca-fac5-4d80-96f9-257f383bb453 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:29:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-530933ca-fac5-4d80-96f9-257f383bb453 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:29:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-530933ca-fac5-4d80-96f9-257f383bb453 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:29:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-530933ca-fac5-4d80-96f9-257f383bb453 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:29:10 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-530933ca-fac5-4d80-96f9-257f383bb453 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:29:10 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-530933ca-fac5-4d80-96f9-257f383bb453 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04" status: 200 len: 1546 microversion: 2.1 time: 0.327701 Apr 13 23:29:10 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 372/1123] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:29:10 2023] GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04 => generated 1546 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:29:10 user devstack@n-api.service[61613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 23:29:10 user devstack@n-api.service[61613]: Thu Apr 13 23:29:10 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04/action (ip 10.0.0.210) !!! Apr 13 23:29:10 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:29:10 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:29:10 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5f239553-9dfb-4e44-9908-df476099f9e9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:29:10 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-5f239553-9dfb-4e44-9908-df476099f9e9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:29:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5f239553-9dfb-4e44-9908-df476099f9e9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:29:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5f239553-9dfb-4e44-9908-df476099f9e9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:29:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5f239553-9dfb-4e44-9908-df476099f9e9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:29:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5f239553-9dfb-4e44-9908-df476099f9e9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:29:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5f239553-9dfb-4e44-9908-df476099f9e9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:29:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5f239553-9dfb-4e44-9908-df476099f9e9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:29:11 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-5f239553-9dfb-4e44-9908-df476099f9e9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04/action" status: 200 len: 28338 microversion: 2.1 time: 0.272373 Apr 13 23:29:11 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 379/1124] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 23:29:10 2023] POST /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04/action => generated 28338 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 23:29:11 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-83664340-916b-4bf7-b0bf-32511b20ab7a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:29:11 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-83664340-916b-4bf7-b0bf-32511b20ab7a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:29:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-83664340-916b-4bf7-b0bf-32511b20ab7a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:29:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-83664340-916b-4bf7-b0bf-32511b20ab7a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:29:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-83664340-916b-4bf7-b0bf-32511b20ab7a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:29:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-83664340-916b-4bf7-b0bf-32511b20ab7a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:29:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-83664340-916b-4bf7-b0bf-32511b20ab7a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:29:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-83664340-916b-4bf7-b0bf-32511b20ab7a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:29:11 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-83664340-916b-4bf7-b0bf-32511b20ab7a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:29:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-83664340-916b-4bf7-b0bf-32511b20ab7a tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5af8749-cd19-4828-b6f6-e3628da12f01" status: 200 len: 1538 microversion: 2.1 time: 0.149192 Apr 13 23:29:11 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 374/1125] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:29:11 2023] GET /compute/v2.1/servers/b5af8749-cd19-4828-b6f6-e3628da12f01 => generated 1538 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:30:09 user devstack@n-api.service[61612]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49c4da57-1294-4b5c-8e4e-0391f561071e] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 13 23:30:09 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:30:09 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:30:09 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-0b339d13-c546-4894-97c9-feec397306bf tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:30:09 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-0b339d13-c546-4894-97c9-feec397306bf tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:30:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0b339d13-c546-4894-97c9-feec397306bf tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:30:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0b339d13-c546-4894-97c9-feec397306bf tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:30:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0b339d13-c546-4894-97c9-feec397306bf tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:30:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0b339d13-c546-4894-97c9-feec397306bf tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:30:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0b339d13-c546-4894-97c9-feec397306bf tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:30:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0b339d13-c546-4894-97c9-feec397306bf tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:30:09 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-0b339d13-c546-4894-97c9-feec397306bf tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052821 Apr 13 23:30:09 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 373/1126] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 23:30:09 2023] GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:30:10 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:30:10 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:30:10 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:30:10 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:30:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:30:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:30:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:30:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:30:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:30:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:30:10 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:30:10 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" status: 204 len: 0 microversion: 2.20 time: 0.192922 Apr 13 23:30:10 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 380/1127] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 23:30:09 2023] DELETE /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 23:30:10 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-4df55ea9-e060-4896-afde-e047ca7a0036 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:30:10 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-4df55ea9-e060-4896-afde-e047ca7a0036 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:30:10 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:30:10 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=12 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:30:10 user devstack@n-api.service[61611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 23:30:10 user devstack@n-api.service[61611]: Thu Apr 13 23:30:10 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a (ip 10.0.0.210) !!! Apr 13 23:30:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4df55ea9-e060-4896-afde-e047ca7a0036 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:30:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4df55ea9-e060-4896-afde-e047ca7a0036 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:30:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4df55ea9-e060-4896-afde-e047ca7a0036 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:30:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4df55ea9-e060-4896-afde-e047ca7a0036 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:30:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4df55ea9-e060-4896-afde-e047ca7a0036 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:30:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4df55ea9-e060-4896-afde-e047ca7a0036 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:30:10 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-4df55ea9-e060-4896-afde-e047ca7a0036 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:30:10 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-4df55ea9-e060-4896-afde-e047ca7a0036 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:30:10 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-4df55ea9-e060-4896-afde-e047ca7a0036 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:30:10 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-4df55ea9-e060-4896-afde-e047ca7a0036 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" status: 200 len: 1711 microversion: 2.20 time: 0.229087 Apr 13 23:30:10 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 375/1128] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:30:10 2023] GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a => generated 1711 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 23:30:10 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-0f7a0279-1ca0-4cf5-86b7-e0310f2c3ab5 req-6bfaaed9-5f13-4f6d-9a77-82f33c108308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a", "name": "network-vif-unplugged", "status": "completed", "tag": "35f2f7df-8994-44fe-af00-26d1a8f24c83"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:30:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-0f7a0279-1ca0-4cf5-86b7-e0310f2c3ab5 req-6bfaaed9-5f13-4f6d-9a77-82f33c108308 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:30:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-0f7a0279-1ca0-4cf5-86b7-e0310f2c3ab5 req-6bfaaed9-5f13-4f6d-9a77-82f33c108308 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:30:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-0f7a0279-1ca0-4cf5-86b7-e0310f2c3ab5 req-6bfaaed9-5f13-4f6d-9a77-82f33c108308 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:30:10 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-0f7a0279-1ca0-4cf5-86b7-e0310f2c3ab5 req-6bfaaed9-5f13-4f6d-9a77-82f33c108308 service nova] Creating event network-vif-unplugged:35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a on user Apr 13 23:30:10 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-0f7a0279-1ca0-4cf5-86b7-e0310f2c3ab5 req-6bfaaed9-5f13-4f6d-9a77-82f33c108308 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029162 Apr 13 23:30:10 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 374/1129] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:30:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:30:11 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:30:11 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:30:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:30:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:30:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:30:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:30:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:30:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:30:11 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:30:11 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04" status: 204 len: 0 microversion: 2.1 time: 0.127948 Apr 13 23:30:11 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 381/1130] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:30:11 2023] DELETE /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:30:11 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-4699325e-c9e5-43de-8089-8bb6065362b6 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:30:11 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-4699325e-c9e5-43de-8089-8bb6065362b6 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:30:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4699325e-c9e5-43de-8089-8bb6065362b6 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:30:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4699325e-c9e5-43de-8089-8bb6065362b6 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:30:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4699325e-c9e5-43de-8089-8bb6065362b6 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:30:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4699325e-c9e5-43de-8089-8bb6065362b6 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:30:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4699325e-c9e5-43de-8089-8bb6065362b6 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:30:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4699325e-c9e5-43de-8089-8bb6065362b6 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:30:11 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-4699325e-c9e5-43de-8089-8bb6065362b6 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:30:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-4699325e-c9e5-43de-8089-8bb6065362b6 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04" status: 200 len: 1552 microversion: 2.1 time: 0.159773 Apr 13 23:30:11 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 376/1131] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:30:11 2023] GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04 => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:30:11 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-a6e312eb-3234-43e6-81b6-164f91f0a14d req-883d461f-3ba6-4a0e-b022-68b29836d99d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba1c8fe-0485-4d72-b82a-354c2b21ce04", "name": "network-vif-unplugged", "status": "completed", "tag": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:30:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a6e312eb-3234-43e6-81b6-164f91f0a14d req-883d461f-3ba6-4a0e-b022-68b29836d99d service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:30:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a6e312eb-3234-43e6-81b6-164f91f0a14d req-883d461f-3ba6-4a0e-b022-68b29836d99d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:30:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a6e312eb-3234-43e6-81b6-164f91f0a14d req-883d461f-3ba6-4a0e-b022-68b29836d99d service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:30:11 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-a6e312eb-3234-43e6-81b6-164f91f0a14d req-883d461f-3ba6-4a0e-b022-68b29836d99d service nova] Creating event network-vif-unplugged:32c825d8-b7d0-42c1-b8bd-49b1d35821f9 for instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 on user Apr 13 23:30:11 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-a6e312eb-3234-43e6-81b6-164f91f0a14d req-883d461f-3ba6-4a0e-b022-68b29836d99d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029430 Apr 13 23:30:11 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 375/1132] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:30:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:30:11 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-64d45143-de53-4990-8f99-a3b062f7e801 req-d0645ef7-ab60-46d2-94bd-30207bac1c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a", "name": "network-vif-deleted", "tag": "35f2f7df-8994-44fe-af00-26d1a8f24c83"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:30:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-64d45143-de53-4990-8f99-a3b062f7e801 req-d0645ef7-ab60-46d2-94bd-30207bac1c73 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:30:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-64d45143-de53-4990-8f99-a3b062f7e801 req-d0645ef7-ab60-46d2-94bd-30207bac1c73 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:30:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-64d45143-de53-4990-8f99-a3b062f7e801 req-d0645ef7-ab60-46d2-94bd-30207bac1c73 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:30:12 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-64d45143-de53-4990-8f99-a3b062f7e801 req-d0645ef7-ab60-46d2-94bd-30207bac1c73 service nova] Creating event network-vif-deleted:35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a on user Apr 13 23:30:12 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-64d45143-de53-4990-8f99-a3b062f7e801 req-d0645ef7-ab60-46d2-94bd-30207bac1c73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116269 Apr 13 23:30:12 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 382/1133] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:30:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:30:12 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-04575fb4-fef2-422d-a499-7894b6f39c9d req-8fd7cff8-6d4f-4335-82ec-b3dde1658996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a", "name": "network-vif-plugged", "status": "completed", "tag": "35f2f7df-8994-44fe-af00-26d1a8f24c83"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:30:12 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-04575fb4-fef2-422d-a499-7894b6f39c9d req-8fd7cff8-6d4f-4335-82ec-b3dde1658996 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:30:12 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-04575fb4-fef2-422d-a499-7894b6f39c9d req-8fd7cff8-6d4f-4335-82ec-b3dde1658996 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:30:12 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-04575fb4-fef2-422d-a499-7894b6f39c9d req-8fd7cff8-6d4f-4335-82ec-b3dde1658996 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:30:12 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-04575fb4-fef2-422d-a499-7894b6f39c9d req-8fd7cff8-6d4f-4335-82ec-b3dde1658996 service nova] Creating event network-vif-plugged:35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a on user Apr 13 23:30:12 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-04575fb4-fef2-422d-a499-7894b6f39c9d req-8fd7cff8-6d4f-4335-82ec-b3dde1658996 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045728 Apr 13 23:30:12 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 377/1134] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:30:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:30:13 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-ca8c29ad-6a6d-499f-be87-28386faf45d7 req-53c7cb32-f966-4c41-a932-5853d5e36f62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba1c8fe-0485-4d72-b82a-354c2b21ce04", "name": "network-vif-plugged", "status": "completed", "tag": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:30:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-ca8c29ad-6a6d-499f-be87-28386faf45d7 req-53c7cb32-f966-4c41-a932-5853d5e36f62 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:30:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-ca8c29ad-6a6d-499f-be87-28386faf45d7 req-53c7cb32-f966-4c41-a932-5853d5e36f62 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:30:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-ca8c29ad-6a6d-499f-be87-28386faf45d7 req-53c7cb32-f966-4c41-a932-5853d5e36f62 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:30:13 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-ca8c29ad-6a6d-499f-be87-28386faf45d7 req-53c7cb32-f966-4c41-a932-5853d5e36f62 service nova] Creating event network-vif-plugged:32c825d8-b7d0-42c1-b8bd-49b1d35821f9 for instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 on user Apr 13 23:30:13 user devstack@n-api.service[61612]: INFO oslo.messaging._drivers.impl_rabbit [-] [49c4da57-1294-4b5c-8e4e-0391f561071e] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 60562. Apr 13 23:30:13 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-ca8c29ad-6a6d-499f-be87-28386faf45d7 req-53c7cb32-f966-4c41-a932-5853d5e36f62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030329 Apr 13 23:30:13 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 376/1135] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:30:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:30:14 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-4b717c7d-8e88-494d-b5a9-37426d9b7361 req-7cc4d1e8-3df0-4b57-a12b-685abe8b2622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba1c8fe-0485-4d72-b82a-354c2b21ce04", "name": "network-vif-deleted", "tag": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:30:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4b717c7d-8e88-494d-b5a9-37426d9b7361 req-7cc4d1e8-3df0-4b57-a12b-685abe8b2622 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:30:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4b717c7d-8e88-494d-b5a9-37426d9b7361 req-7cc4d1e8-3df0-4b57-a12b-685abe8b2622 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:30:14 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-4b717c7d-8e88-494d-b5a9-37426d9b7361 req-7cc4d1e8-3df0-4b57-a12b-685abe8b2622 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:30:14 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-4b717c7d-8e88-494d-b5a9-37426d9b7361 req-7cc4d1e8-3df0-4b57-a12b-685abe8b2622 service nova] Creating event network-vif-deleted:32c825d8-b7d0-42c1-b8bd-49b1d35821f9 for instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 on user Apr 13 23:30:14 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-4b717c7d-8e88-494d-b5a9-37426d9b7361 req-7cc4d1e8-3df0-4b57-a12b-685abe8b2622 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029616 Apr 13 23:30:14 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 383/1136] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:30:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:31:00 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:31:00 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=14 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:31:00 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b55dc718-3c6a-4b22-bc6c-b29eadb38708 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:00 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-b55dc718-3c6a-4b22-bc6c-b29eadb38708 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:31:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b55dc718-3c6a-4b22-bc6c-b29eadb38708 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b55dc718-3c6a-4b22-bc6c-b29eadb38708 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b55dc718-3c6a-4b22-bc6c-b29eadb38708 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b55dc718-3c6a-4b22-bc6c-b29eadb38708 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b55dc718-3c6a-4b22-bc6c-b29eadb38708 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b55dc718-3c6a-4b22-bc6c-b29eadb38708 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:00 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-b55dc718-3c6a-4b22-bc6c-b29eadb38708 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] HTTP exception thrown: Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a could not be found. Apr 13 23:31:00 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b55dc718-3c6a-4b22-bc6c-b29eadb38708 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Request method failure captured: Apr 13 23:31:00 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a HTTP/1.1 Apr 13 23:31:00 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:31:00 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:31:00 user devstack@n-api.service[61611]: Connection: close Apr 13 23:31:00 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:31:00 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:31:00 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:31:00 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:31:00 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:31:00 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOI11KDFVoA-Mq1f-CiQvEozl4OwMulnX1XRQoPSo2AM_FhijWOXDbqFw1NBgF2IP63yoHa4B67zv1-7N8AzQNk3BaiD5QAkDuuggpPiOhYFcKmzVuwVbNJu2KWU-SkEBoEV09wVx-BC-SUqnhwoj7Rn0-R3Co9vBuxDcXeBXyxJr0LI Apr 13 23:31:00 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:31:00 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:31:00 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:31:00 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:31:00 user devstack@n-api.service[61611]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 23:31:00 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:31:00 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:31:00 user devstack@n-api.service[61611]: X-Project-Id: b9ad0d0e72ad43cca506267d62269910 Apr 13 23:31:00 user devstack@n-api.service[61611]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-953327095 Apr 13 23:31:00 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:31:00 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:31:00 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b9ad0d0e72ad43cca506267d62269910"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9ad0d0e72ad43cca506267d62269910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9ad0d0e72ad43cca506267d62269910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:31:00 user devstack@n-api.service[61611]: X-Tenant: tempest-AttachVolumeShelveTestJSON-953327095 Apr 13 23:31:00 user devstack@n-api.service[61611]: X-Tenant-Id: b9ad0d0e72ad43cca506267d62269910 Apr 13 23:31:00 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-953327095 Apr 13 23:31:00 user devstack@n-api.service[61611]: X-User: tempest-AttachVolumeShelveTestJSON-953327095-project-member Apr 13 23:31:00 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:31:00 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:31:00 user devstack@n-api.service[61611]: X-User-Id: e66f624501c3404bb1eb9412a8a6c951 Apr 13 23:31:00 user devstack@n-api.service[61611]: X-User-Name: tempest-AttachVolumeShelveTestJSON-953327095-project-member Apr 13 23:31:00 user devstack@n-api.service[61611]: method: > Apr 13 23:31:00 user devstack@n-api.service[61611]: exception: Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a could not be found. Apr 13 23:31:00 user devstack@n-api.service[61611]: action_args: {'id': 'f06f6eff-76a8-4c0a-9e11-b49b0c09e22a'} Apr 13 23:31:00 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a could not be found. Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a could not be found. Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a could not be found. Apr 13 23:31:00 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:31:00 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b55dc718-3c6a-4b22-bc6c-b29eadb38708 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Returning 404 to user: Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:31:00 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-b55dc718-3c6a-4b22-bc6c-b29eadb38708 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" status: 404 len: 111 microversion: 2.20 time: 0.044125 Apr 13 23:31:00 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 378/1137] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:31:00 2023] GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:31:00 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=8 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:31:00 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=12 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:31:00 user devstack@n-api.service[61612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 23:31:00 user devstack@n-api.service[61612]: Thu Apr 13 23:31:00 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1255905063 (ip 10.0.0.210) !!! Apr 13 23:31:00 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-ae30b287-623d-4a4e-a39c-93c029c43f83 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '.version_select at 0x7f3d1e1245e0>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:00 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-ae30b287-623d-4a4e-a39c-93c029c43f83 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255905063" status: 204 len: 0 microversion: 2.20 time: 0.036374 Apr 13 23:31:00 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 377/1138] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 13 23:31:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255905063 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8bad09c3-ebc4-460a-bcd0-febbbbdc1f89 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-8bad09c3-ebc4-460a-bcd0-febbbbdc1f89 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8bad09c3-ebc4-460a-bcd0-febbbbdc1f89 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8bad09c3-ebc4-460a-bcd0-febbbbdc1f89 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8bad09c3-ebc4-460a-bcd0-febbbbdc1f89 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8bad09c3-ebc4-460a-bcd0-febbbbdc1f89 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8bad09c3-ebc4-460a-bcd0-febbbbdc1f89 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8bad09c3-ebc4-460a-bcd0-febbbbdc1f89 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:01 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-8bad09c3-ebc4-460a-bcd0-febbbbdc1f89 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] HTTP exception thrown: Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 could not be found. Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8bad09c3-ebc4-460a-bcd0-febbbbdc1f89 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Request method failure captured: Apr 13 23:31:01 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04 HTTP/1.1 Apr 13 23:31:01 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:31:01 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:31:01 user devstack@n-api.service[61613]: Connection: close Apr 13 23:31:01 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:31:01 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:31:01 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:31:01 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:31:01 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:31:01 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIsprdmfAw_p4rozBbVwBT6Q-6RAJfFduOW0uBnZ9BZYwribtaPAynuD0u5SvQ-qSyV1qE9p-YGqiNKGPBfx4M0QkItrbmmlg5JeLj_f7yd_F1DQwSDmF4pVpShA4f3L3ELimyxWwQ2-JHK5pfZjQLSh6Xk-65WD5-EohxGIW2s73Ps Apr 13 23:31:01 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:31:01 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:31:01 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:31:01 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:31:01 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:31:01 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:31:01 user devstack@n-api.service[61613]: X-Project-Id: 68330047a5fd4e4397cf5edca18c5b51 Apr 13 23:31:01 user devstack@n-api.service[61613]: X-Project-Name: tempest-ServerActionsTestJSON-372556233 Apr 13 23:31:01 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:31:01 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:31:01 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:31:01 user devstack@n-api.service[61613]: X-Tenant: tempest-ServerActionsTestJSON-372556233 Apr 13 23:31:01 user devstack@n-api.service[61613]: X-Tenant-Id: 68330047a5fd4e4397cf5edca18c5b51 Apr 13 23:31:01 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-ServerActionsTestJSON-372556233 Apr 13 23:31:01 user devstack@n-api.service[61613]: X-User: tempest-ServerActionsTestJSON-372556233-project-member Apr 13 23:31:01 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:31:01 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:31:01 user devstack@n-api.service[61613]: X-User-Id: 59b2c11a23384f678a086de89139497d Apr 13 23:31:01 user devstack@n-api.service[61613]: X-User-Name: tempest-ServerActionsTestJSON-372556233-project-member Apr 13 23:31:01 user devstack@n-api.service[61613]: method: > Apr 13 23:31:01 user devstack@n-api.service[61613]: exception: Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 could not be found. Apr 13 23:31:01 user devstack@n-api.service[61613]: action_args: {'id': '0ba1c8fe-0485-4d72-b82a-354c2b21ce04'} Apr 13 23:31:01 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 could not be found. Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 could not be found. Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 could not be found. Apr 13 23:31:01 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8bad09c3-ebc4-460a-bcd0-febbbbdc1f89 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Returning 404 to user: Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:31:01 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-8bad09c3-ebc4-460a-bcd0-febbbbdc1f89 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04" status: 404 len: 111 microversion: 2.1 time: 0.050831 Apr 13 23:31:01 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 384/1139] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:31:01 2023] GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:31:01 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-4a904e0e-ad0d-4dc6-94b1-ca976e5c3f3e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:01 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-4a904e0e-ad0d-4dc6-94b1-ca976e5c3f3e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:31:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4a904e0e-ad0d-4dc6-94b1-ca976e5c3f3e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4a904e0e-ad0d-4dc6-94b1-ca976e5c3f3e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4a904e0e-ad0d-4dc6-94b1-ca976e5c3f3e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4a904e0e-ad0d-4dc6-94b1-ca976e5c3f3e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4a904e0e-ad0d-4dc6-94b1-ca976e5c3f3e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4a904e0e-ad0d-4dc6-94b1-ca976e5c3f3e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:01 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-4a904e0e-ad0d-4dc6-94b1-ca976e5c3f3e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] HTTP exception thrown: Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 could not be found. Apr 13 23:31:01 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-4a904e0e-ad0d-4dc6-94b1-ca976e5c3f3e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Request method failure captured: Apr 13 23:31:01 user devstack@n-api.service[61611]: request: DELETE /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04 HTTP/1.1 Apr 13 23:31:01 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:31:01 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:31:01 user devstack@n-api.service[61611]: Connection: close Apr 13 23:31:01 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:31:01 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:31:01 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:31:01 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:31:01 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:31:01 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIsprdmfAw_p4rozBbVwBT6Q-6RAJfFduOW0uBnZ9BZYwribtaPAynuD0u5SvQ-qSyV1qE9p-YGqiNKGPBfx4M0QkItrbmmlg5JeLj_f7yd_F1DQwSDmF4pVpShA4f3L3ELimyxWwQ2-JHK5pfZjQLSh6Xk-65WD5-EohxGIW2s73Ps Apr 13 23:31:01 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:31:01 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:31:01 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:31:01 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:31:01 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:31:01 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:31:01 user devstack@n-api.service[61611]: X-Project-Id: 68330047a5fd4e4397cf5edca18c5b51 Apr 13 23:31:01 user devstack@n-api.service[61611]: X-Project-Name: tempest-ServerActionsTestJSON-372556233 Apr 13 23:31:01 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:31:01 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:31:01 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:31:01 user devstack@n-api.service[61611]: X-Tenant: tempest-ServerActionsTestJSON-372556233 Apr 13 23:31:01 user devstack@n-api.service[61611]: X-Tenant-Id: 68330047a5fd4e4397cf5edca18c5b51 Apr 13 23:31:01 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-ServerActionsTestJSON-372556233 Apr 13 23:31:01 user devstack@n-api.service[61611]: X-User: tempest-ServerActionsTestJSON-372556233-project-member Apr 13 23:31:01 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:31:01 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:31:01 user devstack@n-api.service[61611]: X-User-Id: 59b2c11a23384f678a086de89139497d Apr 13 23:31:01 user devstack@n-api.service[61611]: X-User-Name: tempest-ServerActionsTestJSON-372556233-project-member Apr 13 23:31:01 user devstack@n-api.service[61611]: method: > Apr 13 23:31:01 user devstack@n-api.service[61611]: exception: Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 could not be found. Apr 13 23:31:01 user devstack@n-api.service[61611]: action_args: {'id': '0ba1c8fe-0485-4d72-b82a-354c2b21ce04'} Apr 13 23:31:01 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 could not be found. Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 could not be found. Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 could not be found. Apr 13 23:31:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:31:01 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-4a904e0e-ad0d-4dc6-94b1-ca976e5c3f3e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Returning 404 to user: Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:31:01 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-4a904e0e-ad0d-4dc6-94b1-ca976e5c3f3e tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04" status: 404 len: 111 microversion: 2.1 time: 0.027068 Apr 13 23:31:01 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 379/1140] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:31:01 2023] DELETE /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:31:01 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-630a2bdf-5815-4acd-94f2-24cd6ae7c773 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:01 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-630a2bdf-5815-4acd-94f2-24cd6ae7c773 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:31:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-630a2bdf-5815-4acd-94f2-24cd6ae7c773 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-630a2bdf-5815-4acd-94f2-24cd6ae7c773 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-630a2bdf-5815-4acd-94f2-24cd6ae7c773 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-630a2bdf-5815-4acd-94f2-24cd6ae7c773 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-630a2bdf-5815-4acd-94f2-24cd6ae7c773 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-630a2bdf-5815-4acd-94f2-24cd6ae7c773 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:01 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-630a2bdf-5815-4acd-94f2-24cd6ae7c773 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] HTTP exception thrown: Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 could not be found. Apr 13 23:31:01 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-630a2bdf-5815-4acd-94f2-24cd6ae7c773 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Request method failure captured: Apr 13 23:31:01 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04 HTTP/1.1 Apr 13 23:31:01 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:31:01 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:31:01 user devstack@n-api.service[61612]: Connection: close Apr 13 23:31:01 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:31:01 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:31:01 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:31:01 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:31:01 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:31:01 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIsprdmfAw_p4rozBbVwBT6Q-6RAJfFduOW0uBnZ9BZYwribtaPAynuD0u5SvQ-qSyV1qE9p-YGqiNKGPBfx4M0QkItrbmmlg5JeLj_f7yd_F1DQwSDmF4pVpShA4f3L3ELimyxWwQ2-JHK5pfZjQLSh6Xk-65WD5-EohxGIW2s73Ps Apr 13 23:31:01 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:31:01 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:31:01 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:31:01 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:31:01 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:31:01 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:31:01 user devstack@n-api.service[61612]: X-Project-Id: 68330047a5fd4e4397cf5edca18c5b51 Apr 13 23:31:01 user devstack@n-api.service[61612]: X-Project-Name: tempest-ServerActionsTestJSON-372556233 Apr 13 23:31:01 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:31:01 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:31:01 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:31:01 user devstack@n-api.service[61612]: X-Tenant: tempest-ServerActionsTestJSON-372556233 Apr 13 23:31:01 user devstack@n-api.service[61612]: X-Tenant-Id: 68330047a5fd4e4397cf5edca18c5b51 Apr 13 23:31:01 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-ServerActionsTestJSON-372556233 Apr 13 23:31:01 user devstack@n-api.service[61612]: X-User: tempest-ServerActionsTestJSON-372556233-project-member Apr 13 23:31:01 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:31:01 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:31:01 user devstack@n-api.service[61612]: X-User-Id: 59b2c11a23384f678a086de89139497d Apr 13 23:31:01 user devstack@n-api.service[61612]: X-User-Name: tempest-ServerActionsTestJSON-372556233-project-member Apr 13 23:31:01 user devstack@n-api.service[61612]: method: > Apr 13 23:31:01 user devstack@n-api.service[61612]: exception: Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 could not be found. Apr 13 23:31:01 user devstack@n-api.service[61612]: action_args: {'id': '0ba1c8fe-0485-4d72-b82a-354c2b21ce04'} Apr 13 23:31:01 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 could not be found. Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 could not be found. Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 could not be found. Apr 13 23:31:01 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:31:01 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-630a2bdf-5815-4acd-94f2-24cd6ae7c773 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Returning 404 to user: Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:31:01 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-630a2bdf-5815-4acd-94f2-24cd6ae7c773 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04" status: 404 len: 111 microversion: 2.1 time: 0.027037 Apr 13 23:31:01 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 378/1141] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:31:01 2023] GET /compute/v2.1/servers/0ba1c8fe-0485-4d72-b82a-354c2b21ce04 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:01 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 23:31:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b5af8749-cd19-4828-b6f6-e3628da12f01" status: 204 len: 0 microversion: 2.1 time: 0.122306 Apr 13 23:31:02 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 385/1142] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:31:01 2023] DELETE /compute/v2.1/servers/b5af8749-cd19-4828-b6f6-e3628da12f01 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 23:31:02 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-84c5db1c-eeb5-4663-9486-c2dadfa2edf1 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:02 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-84c5db1c-eeb5-4663-9486-c2dadfa2edf1 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:31:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-84c5db1c-eeb5-4663-9486-c2dadfa2edf1 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-84c5db1c-eeb5-4663-9486-c2dadfa2edf1 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-84c5db1c-eeb5-4663-9486-c2dadfa2edf1 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-84c5db1c-eeb5-4663-9486-c2dadfa2edf1 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-84c5db1c-eeb5-4663-9486-c2dadfa2edf1 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-84c5db1c-eeb5-4663-9486-c2dadfa2edf1 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:02 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-84c5db1c-eeb5-4663-9486-c2dadfa2edf1 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 23:31:02 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-84c5db1c-eeb5-4663-9486-c2dadfa2edf1 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5af8749-cd19-4828-b6f6-e3628da12f01" status: 200 len: 1544 microversion: 2.1 time: 0.270231 Apr 13 23:31:02 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 380/1143] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:31:02 2023] GET /compute/v2.1/servers/b5af8749-cd19-4828-b6f6-e3628da12f01 => generated 1544 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:31:02 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-beecb322-d220-4d72-8243-d2dba1040444 req-77827646-ab9d-4efc-b93f-1ec820b483b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5af8749-cd19-4828-b6f6-e3628da12f01", "name": "network-vif-unplugged", "status": "completed", "tag": "1f5d0400-132c-4746-9b98-a86dfc3511af"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:31:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-beecb322-d220-4d72-8243-d2dba1040444 req-77827646-ab9d-4efc-b93f-1ec820b483b6 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-beecb322-d220-4d72-8243-d2dba1040444 req-77827646-ab9d-4efc-b93f-1ec820b483b6 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-beecb322-d220-4d72-8243-d2dba1040444 req-77827646-ab9d-4efc-b93f-1ec820b483b6 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-beecb322-d220-4d72-8243-d2dba1040444 req-77827646-ab9d-4efc-b93f-1ec820b483b6 service nova] Creating event network-vif-unplugged:1f5d0400-132c-4746-9b98-a86dfc3511af for instance b5af8749-cd19-4828-b6f6-e3628da12f01 on user Apr 13 23:31:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-beecb322-d220-4d72-8243-d2dba1040444 req-77827646-ab9d-4efc-b93f-1ec820b483b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030017 Apr 13 23:31:02 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 379/1144] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:31:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:31:03 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-dce39bc0-180a-4ea4-9100-6a3627bf7e7d req-bbc0b952-9484-43a2-bd22-fc6226430c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5af8749-cd19-4828-b6f6-e3628da12f01", "name": "network-vif-deleted", "tag": "1f5d0400-132c-4746-9b98-a86dfc3511af"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:31:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-dce39bc0-180a-4ea4-9100-6a3627bf7e7d req-bbc0b952-9484-43a2-bd22-fc6226430c04 service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-dce39bc0-180a-4ea4-9100-6a3627bf7e7d req-bbc0b952-9484-43a2-bd22-fc6226430c04 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-dce39bc0-180a-4ea4-9100-6a3627bf7e7d req-bbc0b952-9484-43a2-bd22-fc6226430c04 service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:03 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-dce39bc0-180a-4ea4-9100-6a3627bf7e7d req-bbc0b952-9484-43a2-bd22-fc6226430c04 service nova] Creating event network-vif-deleted:1f5d0400-132c-4746-9b98-a86dfc3511af for instance b5af8749-cd19-4828-b6f6-e3628da12f01 on user Apr 13 23:31:03 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-dce39bc0-180a-4ea4-9100-6a3627bf7e7d req-bbc0b952-9484-43a2-bd22-fc6226430c04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038828 Apr 13 23:31:03 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 386/1145] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:31:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:31:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-9d746801-3a9f-4e24-add4-bb9cee64475b req-3f5b3d8f-1838-4093-afe2-b86eee60633a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5af8749-cd19-4828-b6f6-e3628da12f01", "name": "network-vif-plugged", "status": "completed", "tag": "1f5d0400-132c-4746-9b98-a86dfc3511af"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 23:31:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9d746801-3a9f-4e24-add4-bb9cee64475b req-3f5b3d8f-1838-4093-afe2-b86eee60633a service nova] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9d746801-3a9f-4e24-add4-bb9cee64475b req-3f5b3d8f-1838-4093-afe2-b86eee60633a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9d746801-3a9f-4e24-add4-bb9cee64475b req-3f5b3d8f-1838-4093-afe2-b86eee60633a service nova] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:04 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-9d746801-3a9f-4e24-add4-bb9cee64475b req-3f5b3d8f-1838-4093-afe2-b86eee60633a service nova] Creating event network-vif-plugged:1f5d0400-132c-4746-9b98-a86dfc3511af for instance b5af8749-cd19-4828-b6f6-e3628da12f01 on user Apr 13 23:31:04 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-9d746801-3a9f-4e24-add4-bb9cee64475b req-3f5b3d8f-1838-4093-afe2-b86eee60633a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037374 Apr 13 23:31:04 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 381/1146] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 23:31:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:31:04 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-38f10492-3f15-4de5-9a8a-160e158c0244 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:04 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-38f10492-3f15-4de5-9a8a-160e158c0244 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:31:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-38f10492-3f15-4de5-9a8a-160e158c0244 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-38f10492-3f15-4de5-9a8a-160e158c0244 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-38f10492-3f15-4de5-9a8a-160e158c0244 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-38f10492-3f15-4de5-9a8a-160e158c0244 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-38f10492-3f15-4de5-9a8a-160e158c0244 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-38f10492-3f15-4de5-9a8a-160e158c0244 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:04 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-38f10492-3f15-4de5-9a8a-160e158c0244 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] HTTP exception thrown: Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a could not be found. Apr 13 23:31:04 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-38f10492-3f15-4de5-9a8a-160e158c0244 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Request method failure captured: Apr 13 23:31:04 user devstack@n-api.service[61612]: request: DELETE /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a HTTP/1.1 Apr 13 23:31:04 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:31:04 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:31:04 user devstack@n-api.service[61612]: Connection: close Apr 13 23:31:04 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:31:04 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:31:04 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:31:04 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:31:04 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:31:04 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOI11KDFVoA-Mq1f-CiQvEozl4OwMulnX1XRQoPSo2AM_FhijWOXDbqFw1NBgF2IP63yoHa4B67zv1-7N8AzQNk3BaiD5QAkDuuggpPiOhYFcKmzVuwVbNJu2KWU-SkEBoEV09wVx-BC-SUqnhwoj7Rn0-R3Co9vBuxDcXeBXyxJr0LI Apr 13 23:31:04 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:31:04 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:31:04 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:31:04 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:31:04 user devstack@n-api.service[61612]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 23:31:04 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:31:04 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:31:04 user devstack@n-api.service[61612]: X-Project-Id: b9ad0d0e72ad43cca506267d62269910 Apr 13 23:31:04 user devstack@n-api.service[61612]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-953327095 Apr 13 23:31:04 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:31:04 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:31:04 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b9ad0d0e72ad43cca506267d62269910"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9ad0d0e72ad43cca506267d62269910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9ad0d0e72ad43cca506267d62269910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:31:04 user devstack@n-api.service[61612]: X-Tenant: tempest-AttachVolumeShelveTestJSON-953327095 Apr 13 23:31:04 user devstack@n-api.service[61612]: X-Tenant-Id: b9ad0d0e72ad43cca506267d62269910 Apr 13 23:31:04 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-953327095 Apr 13 23:31:04 user devstack@n-api.service[61612]: X-User: tempest-AttachVolumeShelveTestJSON-953327095-project-member Apr 13 23:31:04 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:31:04 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:31:04 user devstack@n-api.service[61612]: X-User-Id: e66f624501c3404bb1eb9412a8a6c951 Apr 13 23:31:04 user devstack@n-api.service[61612]: X-User-Name: tempest-AttachVolumeShelveTestJSON-953327095-project-member Apr 13 23:31:04 user devstack@n-api.service[61612]: method: > Apr 13 23:31:04 user devstack@n-api.service[61612]: exception: Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a could not be found. Apr 13 23:31:04 user devstack@n-api.service[61612]: action_args: {'id': 'f06f6eff-76a8-4c0a-9e11-b49b0c09e22a'} Apr 13 23:31:04 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a could not be found. Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a could not be found. Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a could not be found. Apr 13 23:31:04 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:31:04 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-38f10492-3f15-4de5-9a8a-160e158c0244 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Returning 404 to user: Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:31:04 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-38f10492-3f15-4de5-9a8a-160e158c0244 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" status: 404 len: 111 microversion: 2.20 time: 0.029537 Apr 13 23:31:04 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 380/1147] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 23:31:04 2023] DELETE /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:31:04 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-4a7d206b-bc61-445a-9c7c-2f472bfd88a0 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:04 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-4a7d206b-bc61-445a-9c7c-2f472bfd88a0 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:31:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4a7d206b-bc61-445a-9c7c-2f472bfd88a0 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4a7d206b-bc61-445a-9c7c-2f472bfd88a0 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4a7d206b-bc61-445a-9c7c-2f472bfd88a0 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4a7d206b-bc61-445a-9c7c-2f472bfd88a0 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4a7d206b-bc61-445a-9c7c-2f472bfd88a0 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4a7d206b-bc61-445a-9c7c-2f472bfd88a0 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:04 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-4a7d206b-bc61-445a-9c7c-2f472bfd88a0 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] HTTP exception thrown: Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a could not be found. Apr 13 23:31:04 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-4a7d206b-bc61-445a-9c7c-2f472bfd88a0 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Request method failure captured: Apr 13 23:31:04 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a HTTP/1.1 Apr 13 23:31:04 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:31:04 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:31:04 user devstack@n-api.service[61613]: Connection: close Apr 13 23:31:04 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:31:04 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:31:04 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:31:04 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:31:04 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:31:04 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOI11KDFVoA-Mq1f-CiQvEozl4OwMulnX1XRQoPSo2AM_FhijWOXDbqFw1NBgF2IP63yoHa4B67zv1-7N8AzQNk3BaiD5QAkDuuggpPiOhYFcKmzVuwVbNJu2KWU-SkEBoEV09wVx-BC-SUqnhwoj7Rn0-R3Co9vBuxDcXeBXyxJr0LI Apr 13 23:31:04 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:31:04 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:31:04 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:31:04 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:31:04 user devstack@n-api.service[61613]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 23:31:04 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:31:04 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:31:04 user devstack@n-api.service[61613]: X-Project-Id: b9ad0d0e72ad43cca506267d62269910 Apr 13 23:31:04 user devstack@n-api.service[61613]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-953327095 Apr 13 23:31:04 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:31:04 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:31:04 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b9ad0d0e72ad43cca506267d62269910"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9ad0d0e72ad43cca506267d62269910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9ad0d0e72ad43cca506267d62269910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:31:04 user devstack@n-api.service[61613]: X-Tenant: tempest-AttachVolumeShelveTestJSON-953327095 Apr 13 23:31:04 user devstack@n-api.service[61613]: X-Tenant-Id: b9ad0d0e72ad43cca506267d62269910 Apr 13 23:31:04 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-953327095 Apr 13 23:31:04 user devstack@n-api.service[61613]: X-User: tempest-AttachVolumeShelveTestJSON-953327095-project-member Apr 13 23:31:04 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:31:04 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:31:04 user devstack@n-api.service[61613]: X-User-Id: e66f624501c3404bb1eb9412a8a6c951 Apr 13 23:31:04 user devstack@n-api.service[61613]: X-User-Name: tempest-AttachVolumeShelveTestJSON-953327095-project-member Apr 13 23:31:04 user devstack@n-api.service[61613]: method: > Apr 13 23:31:04 user devstack@n-api.service[61613]: exception: Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a could not be found. Apr 13 23:31:04 user devstack@n-api.service[61613]: action_args: {'id': 'f06f6eff-76a8-4c0a-9e11-b49b0c09e22a'} Apr 13 23:31:04 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a could not be found. Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a could not be found. Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a could not be found. Apr 13 23:31:04 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:31:04 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-4a7d206b-bc61-445a-9c7c-2f472bfd88a0 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Returning 404 to user: Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:31:04 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-4a7d206b-bc61-445a-9c7c-2f472bfd88a0 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" status: 404 len: 111 microversion: 2.20 time: 0.029497 Apr 13 23:31:04 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 387/1148] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:31:04 2023] GET /compute/v2.1/servers/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:31:07 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-01bea7f0-c8de-47b3-8b65-b2017233ad53 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:07 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-01bea7f0-c8de-47b3-8b65-b2017233ad53 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:31:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-01bea7f0-c8de-47b3-8b65-b2017233ad53 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-01bea7f0-c8de-47b3-8b65-b2017233ad53 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-01bea7f0-c8de-47b3-8b65-b2017233ad53 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-01bea7f0-c8de-47b3-8b65-b2017233ad53 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-01bea7f0-c8de-47b3-8b65-b2017233ad53 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-01bea7f0-c8de-47b3-8b65-b2017233ad53 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:07 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-01bea7f0-c8de-47b3-8b65-b2017233ad53 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] HTTP exception thrown: Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 could not be found. Apr 13 23:31:07 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-01bea7f0-c8de-47b3-8b65-b2017233ad53 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Request method failure captured: Apr 13 23:31:07 user devstack@n-api.service[61611]: request: DELETE /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 HTTP/1.1 Apr 13 23:31:07 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:31:07 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:31:07 user devstack@n-api.service[61611]: Connection: close Apr 13 23:31:07 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:31:07 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:31:07 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:31:07 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:31:07 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:31:07 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOI11KDFVoA-Mq1f-CiQvEozl4OwMulnX1XRQoPSo2AM_FhijWOXDbqFw1NBgF2IP63yoHa4B67zv1-7N8AzQNk3BaiD5QAkDuuggpPiOhYFcKmzVuwVbNJu2KWU-SkEBoEV09wVx-BC-SUqnhwoj7Rn0-R3Co9vBuxDcXeBXyxJr0LI Apr 13 23:31:07 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:31:07 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:31:07 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:31:07 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:31:07 user devstack@n-api.service[61611]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 23:31:07 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:31:07 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:31:07 user devstack@n-api.service[61611]: X-Project-Id: b9ad0d0e72ad43cca506267d62269910 Apr 13 23:31:07 user devstack@n-api.service[61611]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-953327095 Apr 13 23:31:07 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:31:07 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:31:07 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b9ad0d0e72ad43cca506267d62269910"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9ad0d0e72ad43cca506267d62269910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9ad0d0e72ad43cca506267d62269910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:31:07 user devstack@n-api.service[61611]: X-Tenant: tempest-AttachVolumeShelveTestJSON-953327095 Apr 13 23:31:07 user devstack@n-api.service[61611]: X-Tenant-Id: b9ad0d0e72ad43cca506267d62269910 Apr 13 23:31:07 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-953327095 Apr 13 23:31:07 user devstack@n-api.service[61611]: X-User: tempest-AttachVolumeShelveTestJSON-953327095-project-member Apr 13 23:31:07 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:31:07 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:31:07 user devstack@n-api.service[61611]: X-User-Id: e66f624501c3404bb1eb9412a8a6c951 Apr 13 23:31:07 user devstack@n-api.service[61611]: X-User-Name: tempest-AttachVolumeShelveTestJSON-953327095-project-member Apr 13 23:31:07 user devstack@n-api.service[61611]: method: > Apr 13 23:31:07 user devstack@n-api.service[61611]: exception: Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 could not be found. Apr 13 23:31:07 user devstack@n-api.service[61611]: action_args: {'id': '7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55'} Apr 13 23:31:07 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 could not be found. Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 could not be found. Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 could not be found. Apr 13 23:31:07 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:31:07 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-01bea7f0-c8de-47b3-8b65-b2017233ad53 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Returning 404 to user: Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:31:07 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-01bea7f0-c8de-47b3-8b65-b2017233ad53 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" status: 404 len: 111 microversion: 2.20 time: 0.032810 Apr 13 23:31:07 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 382/1149] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 23:31:07 2023] DELETE /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:31:07 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-1972a057-9716-401c-bf96-ca85b71c646c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:07 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-1972a057-9716-401c-bf96-ca85b71c646c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:31:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1972a057-9716-401c-bf96-ca85b71c646c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1972a057-9716-401c-bf96-ca85b71c646c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1972a057-9716-401c-bf96-ca85b71c646c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1972a057-9716-401c-bf96-ca85b71c646c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1972a057-9716-401c-bf96-ca85b71c646c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1972a057-9716-401c-bf96-ca85b71c646c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-1972a057-9716-401c-bf96-ca85b71c646c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] HTTP exception thrown: Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 could not be found. Apr 13 23:31:07 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-1972a057-9716-401c-bf96-ca85b71c646c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Request method failure captured: Apr 13 23:31:07 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 HTTP/1.1 Apr 13 23:31:07 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:31:07 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:31:07 user devstack@n-api.service[61612]: Connection: close Apr 13 23:31:07 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:31:07 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:31:07 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:31:07 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:31:07 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:31:07 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOI11KDFVoA-Mq1f-CiQvEozl4OwMulnX1XRQoPSo2AM_FhijWOXDbqFw1NBgF2IP63yoHa4B67zv1-7N8AzQNk3BaiD5QAkDuuggpPiOhYFcKmzVuwVbNJu2KWU-SkEBoEV09wVx-BC-SUqnhwoj7Rn0-R3Co9vBuxDcXeBXyxJr0LI Apr 13 23:31:07 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:31:07 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:31:07 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:31:07 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:31:07 user devstack@n-api.service[61612]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 23:31:07 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:31:07 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:31:07 user devstack@n-api.service[61612]: X-Project-Id: b9ad0d0e72ad43cca506267d62269910 Apr 13 23:31:07 user devstack@n-api.service[61612]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-953327095 Apr 13 23:31:07 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:31:07 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:31:07 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b9ad0d0e72ad43cca506267d62269910"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9ad0d0e72ad43cca506267d62269910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9ad0d0e72ad43cca506267d62269910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:31:07 user devstack@n-api.service[61612]: X-Tenant: tempest-AttachVolumeShelveTestJSON-953327095 Apr 13 23:31:07 user devstack@n-api.service[61612]: X-Tenant-Id: b9ad0d0e72ad43cca506267d62269910 Apr 13 23:31:07 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-953327095 Apr 13 23:31:07 user devstack@n-api.service[61612]: X-User: tempest-AttachVolumeShelveTestJSON-953327095-project-member Apr 13 23:31:07 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:31:07 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:31:07 user devstack@n-api.service[61612]: X-User-Id: e66f624501c3404bb1eb9412a8a6c951 Apr 13 23:31:07 user devstack@n-api.service[61612]: X-User-Name: tempest-AttachVolumeShelveTestJSON-953327095-project-member Apr 13 23:31:07 user devstack@n-api.service[61612]: method: > Apr 13 23:31:07 user devstack@n-api.service[61612]: exception: Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 could not be found. Apr 13 23:31:07 user devstack@n-api.service[61612]: action_args: {'id': '7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55'} Apr 13 23:31:07 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 could not be found. Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 could not be found. Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 could not be found. Apr 13 23:31:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:31:07 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-1972a057-9716-401c-bf96-ca85b71c646c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Returning 404 to user: Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:31:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-1972a057-9716-401c-bf96-ca85b71c646c tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" status: 404 len: 111 microversion: 2.20 time: 0.026950 Apr 13 23:31:07 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 381/1150] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 23:31:07 2023] GET /compute/v2.1/servers/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 23:31:14 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-faf73479-2823-47c1-80bf-321cb522dda7 tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] Calling method '.version_select at 0x7f3d1db74700>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:14 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-faf73479-2823-47c1-80bf-321cb522dda7 tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/df71eb76-4da1-43d8-b58e-6610e6ab92fb" status: 200 len: 351 microversion: 2.1 time: 0.204508 Apr 13 23:31:14 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 388/1151] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 23:31:14 2023] GET /compute/v2.1/os-volumes/df71eb76-4da1-43d8-b58e-6610e6ab92fb => generated 351 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:31:15 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-80c7e6ac-c1dd-43d0-a445-109759eca56a tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] Calling method '.version_select at 0x7f3d1ef4b400>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:15 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-80c7e6ac-c1dd-43d0-a445-109759eca56a tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a5c22b1c-7578-409a-afb9-81810fe9babf" status: 200 len: 351 microversion: 2.1 time: 0.056373 Apr 13 23:31:15 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 383/1152] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 23:31:15 2023] GET /compute/v2.1/os-volumes/a5c22b1c-7578-409a-afb9-81810fe9babf => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:31:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-408a6ba5-2e20-4557-9204-ca921bde3caf tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] Calling method '.version_select at 0x7f3d1dd80430>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:17 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-408a6ba5-2e20-4557-9204-ca921bde3caf tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f465005c-f432-4e83-bc9a-ad2198e48b87" status: 200 len: 349 microversion: 2.1 time: 0.050305 Apr 13 23:31:17 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 382/1153] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 23:31:17 2023] GET /compute/v2.1/os-volumes/f465005c-f432-4e83-bc9a-ad2198e48b87 => generated 349 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:31:17 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-3e6bb805-8223-4b2d-9b8f-7ce94f36b768 tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] Calling method '.version_select at 0x7f3d1dd01510>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:17 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:31:17 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:31:17 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-3e6bb805-8223-4b2d-9b8f-7ce94f36b768 tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.191207 Apr 13 23:31:17 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 389/1154] 10.0.0.210 () {62 vars in 1211 bytes} [Thu Apr 13 23:31:17 2023] GET /compute/v2.1/os-volumes => generated 1034 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:31:17 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-daa496e4-ffb5-40bb-8fca-a4a697707f97 tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] Calling method '.version_select at 0x7f3d1c3feef0>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:17 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-daa496e4-ffb5-40bb-8fca-a4a697707f97 tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.099194 Apr 13 23:31:17 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 384/1155] 10.0.0.210 () {62 vars in 1226 bytes} [Thu Apr 13 23:31:17 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:31:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-d613c436-5898-4378-b696-100011b8d45c tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] Calling method '.version_select at 0x7f3d1df36320>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:17 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-d613c436-5898-4378-b696-100011b8d45c tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.087350 Apr 13 23:31:17 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 383/1156] 10.0.0.210 () {62 vars in 1211 bytes} [Thu Apr 13 23:31:17 2023] GET /compute/v2.1/os-volumes => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:31:17 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-a4752b59-4bfa-4f68-9c6b-2b3052e1e1e7 tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] Calling method '.version_select at 0x7f3d1f791630>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:17 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-a4752b59-4bfa-4f68-9c6b-2b3052e1e1e7 tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087092 Apr 13 23:31:17 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 390/1157] 10.0.0.210 () {62 vars in 1244 bytes} [Thu Apr 13 23:31:17 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:31:17 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-3335eba6-de01-43a9-ab64-2e1c9a3766f3 tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] Calling method '.version_select at 0x7f3d1c507eb0>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:17 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=10 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:31:17 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=14 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:31:17 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-3335eba6-de01-43a9-ab64-2e1c9a3766f3 tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.082699 Apr 13 23:31:17 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 385/1158] 10.0.0.210 () {62 vars in 1247 bytes} [Thu Apr 13 23:31:17 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:31:17 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:31:17 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=8 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 23:31:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-349dd9c4-db94-45c2-8f9d-307d0b65812d tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] Calling method '.version_select at 0x7f3d1dd82b00>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:17 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-349dd9c4-db94-45c2-8f9d-307d0b65812d tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084281 Apr 13 23:31:17 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 384/1159] 10.0.0.210 () {62 vars in 1232 bytes} [Thu Apr 13 23:31:17 2023] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:31:17 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-952d1a3d-09ca-4bb4-a459-789101c5850d tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] Calling method '.version_select at 0x7f3d1dcf1f30>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:18 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-952d1a3d-09ca-4bb4-a459-789101c5850d tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.079961 Apr 13 23:31:18 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 391/1160] 10.0.0.210 () {62 vars in 1265 bytes} [Thu Apr 13 23:31:17 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:31:18 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-cf4ea9a0-4360-4a6a-84b2-5f69768e671e tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] Calling method '.version_select at 0x7f3d1e0bf370>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-cf4ea9a0-4360-4a6a-84b2-5f69768e671e tempest-VolumesTestJSON-279222042 tempest-VolumesTestJSON-279222042-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.082969 Apr 13 23:31:18 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 386/1161] 10.0.0.210 () {62 vars in 1232 bytes} [Thu Apr 13 23:31:18 2023] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 23:31:52 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-62954a41-3ed8-4912-a1a0-d34ef4e70f4f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:52 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-62954a41-3ed8-4912-a1a0-d34ef4e70f4f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:31:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-62954a41-3ed8-4912-a1a0-d34ef4e70f4f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-62954a41-3ed8-4912-a1a0-d34ef4e70f4f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-62954a41-3ed8-4912-a1a0-d34ef4e70f4f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-62954a41-3ed8-4912-a1a0-d34ef4e70f4f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-62954a41-3ed8-4912-a1a0-d34ef4e70f4f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-62954a41-3ed8-4912-a1a0-d34ef4e70f4f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:52 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-62954a41-3ed8-4912-a1a0-d34ef4e70f4f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] HTTP exception thrown: Instance b5af8749-cd19-4828-b6f6-e3628da12f01 could not be found. Apr 13 23:31:52 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-62954a41-3ed8-4912-a1a0-d34ef4e70f4f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Request method failure captured: Apr 13 23:31:52 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/b5af8749-cd19-4828-b6f6-e3628da12f01 HTTP/1.1 Apr 13 23:31:52 user devstack@n-api.service[61612]: Accept: application/json Apr 13 23:31:52 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 13 23:31:52 user devstack@n-api.service[61612]: Connection: close Apr 13 23:31:52 user devstack@n-api.service[61612]: Content-Length: 0 Apr 13 23:31:52 user devstack@n-api.service[61612]: Content-Type: application/json Apr 13 23:31:52 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 13 23:31:52 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 13 23:31:52 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 13 23:31:52 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkOIsprdmfAw_p4rozBbVwBT6Q-6RAJfFduOW0uBnZ9BZYwribtaPAynuD0u5SvQ-qSyV1qE9p-YGqiNKGPBfx4M0QkItrbmmlg5JeLj_f7yd_F1DQwSDmF4pVpShA4f3L3ELimyxWwQ2-JHK5pfZjQLSh6Xk-65WD5-EohxGIW2s73Ps Apr 13 23:31:52 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 13 23:31:52 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 13 23:31:52 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 13 23:31:52 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 13 23:31:52 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 13 23:31:52 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 13 23:31:52 user devstack@n-api.service[61612]: X-Project-Id: 68330047a5fd4e4397cf5edca18c5b51 Apr 13 23:31:52 user devstack@n-api.service[61612]: X-Project-Name: tempest-ServerActionsTestJSON-372556233 Apr 13 23:31:52 user devstack@n-api.service[61612]: X-Role: member,reader Apr 13 23:31:52 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 13 23:31:52 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:31:52 user devstack@n-api.service[61612]: X-Tenant: tempest-ServerActionsTestJSON-372556233 Apr 13 23:31:52 user devstack@n-api.service[61612]: X-Tenant-Id: 68330047a5fd4e4397cf5edca18c5b51 Apr 13 23:31:52 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-ServerActionsTestJSON-372556233 Apr 13 23:31:52 user devstack@n-api.service[61612]: X-User: tempest-ServerActionsTestJSON-372556233-project-member Apr 13 23:31:52 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 13 23:31:52 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 13 23:31:52 user devstack@n-api.service[61612]: X-User-Id: 59b2c11a23384f678a086de89139497d Apr 13 23:31:52 user devstack@n-api.service[61612]: X-User-Name: tempest-ServerActionsTestJSON-372556233-project-member Apr 13 23:31:52 user devstack@n-api.service[61612]: method: > Apr 13 23:31:52 user devstack@n-api.service[61612]: exception: Instance b5af8749-cd19-4828-b6f6-e3628da12f01 could not be found. Apr 13 23:31:52 user devstack@n-api.service[61612]: action_args: {'id': 'b5af8749-cd19-4828-b6f6-e3628da12f01'} Apr 13 23:31:52 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5af8749-cd19-4828-b6f6-e3628da12f01 could not be found. Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5af8749-cd19-4828-b6f6-e3628da12f01 could not be found. Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5af8749-cd19-4828-b6f6-e3628da12f01 could not be found. Apr 13 23:31:52 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 13 23:31:52 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-62954a41-3ed8-4912-a1a0-d34ef4e70f4f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Returning 404 to user: Instance b5af8749-cd19-4828-b6f6-e3628da12f01 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:31:52 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-62954a41-3ed8-4912-a1a0-d34ef4e70f4f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5af8749-cd19-4828-b6f6-e3628da12f01" status: 404 len: 111 microversion: 2.1 time: 0.039002 Apr 13 23:31:52 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 385/1162] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:31:52 2023] GET /compute/v2.1/servers/b5af8749-cd19-4828-b6f6-e3628da12f01 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:31:59 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5a7af129-7c03-42c2-9848-185083bb5344 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:59 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-5a7af129-7c03-42c2-9848-185083bb5344 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:31:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5a7af129-7c03-42c2-9848-185083bb5344 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5a7af129-7c03-42c2-9848-185083bb5344 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5a7af129-7c03-42c2-9848-185083bb5344 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5a7af129-7c03-42c2-9848-185083bb5344 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5a7af129-7c03-42c2-9848-185083bb5344 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5a7af129-7c03-42c2-9848-185083bb5344 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:59 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-5a7af129-7c03-42c2-9848-185083bb5344 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] HTTP exception thrown: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:31:59 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5a7af129-7c03-42c2-9848-185083bb5344 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Request method failure captured: Apr 13 23:31:59 user devstack@n-api.service[61613]: request: DELETE /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d HTTP/1.1 Apr 13 23:31:59 user devstack@n-api.service[61613]: Accept: application/json Apr 13 23:31:59 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 13 23:31:59 user devstack@n-api.service[61613]: Connection: close Apr 13 23:31:59 user devstack@n-api.service[61613]: Content-Length: 0 Apr 13 23:31:59 user devstack@n-api.service[61613]: Content-Type: application/json Apr 13 23:31:59 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 13 23:31:59 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 13 23:31:59 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 13 23:31:59 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkOIsprdmfAw_p4rozBbVwBT6Q-6RAJfFduOW0uBnZ9BZYwribtaPAynuD0u5SvQ-qSyV1qE9p-YGqiNKGPBfx4M0QkItrbmmlg5JeLj_f7yd_F1DQwSDmF4pVpShA4f3L3ELimyxWwQ2-JHK5pfZjQLSh6Xk-65WD5-EohxGIW2s73Ps Apr 13 23:31:59 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 13 23:31:59 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 13 23:31:59 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 13 23:31:59 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 13 23:31:59 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 13 23:31:59 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 13 23:31:59 user devstack@n-api.service[61613]: X-Project-Id: 68330047a5fd4e4397cf5edca18c5b51 Apr 13 23:31:59 user devstack@n-api.service[61613]: X-Project-Name: tempest-ServerActionsTestJSON-372556233 Apr 13 23:31:59 user devstack@n-api.service[61613]: X-Role: member,reader Apr 13 23:31:59 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 13 23:31:59 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:31:59 user devstack@n-api.service[61613]: X-Tenant: tempest-ServerActionsTestJSON-372556233 Apr 13 23:31:59 user devstack@n-api.service[61613]: X-Tenant-Id: 68330047a5fd4e4397cf5edca18c5b51 Apr 13 23:31:59 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-ServerActionsTestJSON-372556233 Apr 13 23:31:59 user devstack@n-api.service[61613]: X-User: tempest-ServerActionsTestJSON-372556233-project-member Apr 13 23:31:59 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 13 23:31:59 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 13 23:31:59 user devstack@n-api.service[61613]: X-User-Id: 59b2c11a23384f678a086de89139497d Apr 13 23:31:59 user devstack@n-api.service[61613]: X-User-Name: tempest-ServerActionsTestJSON-372556233-project-member Apr 13 23:31:59 user devstack@n-api.service[61613]: method: > Apr 13 23:31:59 user devstack@n-api.service[61613]: exception: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:31:59 user devstack@n-api.service[61613]: action_args: {'id': 'd3b4e1d5-1dce-4a64-8e09-68fadfe79a0d'} Apr 13 23:31:59 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:31:59 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 13 23:31:59 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5a7af129-7c03-42c2-9848-185083bb5344 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Returning 404 to user: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:31:59 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-5a7af129-7c03-42c2-9848-185083bb5344 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 404 len: 111 microversion: 2.1 time: 0.033679 Apr 13 23:31:59 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 392/1163] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 23:31:59 2023] DELETE /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:31:59 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-4dedc042-f187-4a8e-a1d6-7092860bd454 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:59 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-4dedc042-f187-4a8e-a1d6-7092860bd454 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 23:31:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4dedc042-f187-4a8e-a1d6-7092860bd454 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4dedc042-f187-4a8e-a1d6-7092860bd454 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4dedc042-f187-4a8e-a1d6-7092860bd454 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4dedc042-f187-4a8e-a1d6-7092860bd454 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "68a91cc6-885a-441b-9070-4df9e8f73102" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:31:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4dedc042-f187-4a8e-a1d6-7092860bd454 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:31:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4dedc042-f187-4a8e-a1d6-7092860bd454 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "68a91cc6-885a-441b-9070-4df9e8f73102" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:31:59 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-4dedc042-f187-4a8e-a1d6-7092860bd454 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] HTTP exception thrown: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:31:59 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-4dedc042-f187-4a8e-a1d6-7092860bd454 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Request method failure captured: Apr 13 23:31:59 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d HTTP/1.1 Apr 13 23:31:59 user devstack@n-api.service[61611]: Accept: application/json Apr 13 23:31:59 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 13 23:31:59 user devstack@n-api.service[61611]: Connection: close Apr 13 23:31:59 user devstack@n-api.service[61611]: Content-Length: 0 Apr 13 23:31:59 user devstack@n-api.service[61611]: Content-Type: application/json Apr 13 23:31:59 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 13 23:31:59 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 13 23:31:59 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 13 23:31:59 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkOIsprdmfAw_p4rozBbVwBT6Q-6RAJfFduOW0uBnZ9BZYwribtaPAynuD0u5SvQ-qSyV1qE9p-YGqiNKGPBfx4M0QkItrbmmlg5JeLj_f7yd_F1DQwSDmF4pVpShA4f3L3ELimyxWwQ2-JHK5pfZjQLSh6Xk-65WD5-EohxGIW2s73Ps Apr 13 23:31:59 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 13 23:31:59 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 13 23:31:59 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 13 23:31:59 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 13 23:31:59 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 13 23:31:59 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 13 23:31:59 user devstack@n-api.service[61611]: X-Project-Id: 68330047a5fd4e4397cf5edca18c5b51 Apr 13 23:31:59 user devstack@n-api.service[61611]: X-Project-Name: tempest-ServerActionsTestJSON-372556233 Apr 13 23:31:59 user devstack@n-api.service[61611]: X-Role: member,reader Apr 13 23:31:59 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 13 23:31:59 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68330047a5fd4e4397cf5edca18c5b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 13 23:31:59 user devstack@n-api.service[61611]: X-Tenant: tempest-ServerActionsTestJSON-372556233 Apr 13 23:31:59 user devstack@n-api.service[61611]: X-Tenant-Id: 68330047a5fd4e4397cf5edca18c5b51 Apr 13 23:31:59 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-ServerActionsTestJSON-372556233 Apr 13 23:31:59 user devstack@n-api.service[61611]: X-User: tempest-ServerActionsTestJSON-372556233-project-member Apr 13 23:31:59 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 13 23:31:59 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 13 23:31:59 user devstack@n-api.service[61611]: X-User-Id: 59b2c11a23384f678a086de89139497d Apr 13 23:31:59 user devstack@n-api.service[61611]: X-User-Name: tempest-ServerActionsTestJSON-372556233-project-member Apr 13 23:31:59 user devstack@n-api.service[61611]: method: > Apr 13 23:31:59 user devstack@n-api.service[61611]: exception: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:31:59 user devstack@n-api.service[61611]: action_args: {'id': 'd3b4e1d5-1dce-4a64-8e09-68fadfe79a0d'} Apr 13 23:31:59 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. Apr 13 23:31:59 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 13 23:31:59 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-4dedc042-f187-4a8e-a1d6-7092860bd454 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Returning 404 to user: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 23:31:59 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-4dedc042-f187-4a8e-a1d6-7092860bd454 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" status: 404 len: 111 microversion: 2.1 time: 0.039491 Apr 13 23:31:59 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 387/1164] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 23:31:59 2023] GET /compute/v2.1/servers/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 23:31:59 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-42f3ca9a-62c4-47e5-aa39-eaf9ac5a45ae tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Calling method '.version_select at 0x7f3d1e124670>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:31:59 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-42f3ca9a-62c4-47e5-aa39-eaf9ac5a45ae tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1382560979" status: 202 len: 0 microversion: 2.1 time: 0.022660 Apr 13 23:31:59 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 386/1165] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 23:31:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1382560979 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)